TITLE OF THE INVENTION 
SYSTEM FOR RECORDING AUDIO INFORMATION WITH IMAGE 
CROSS-REFERENCE TO RELATED APPLICATIONS 
This application is based upon and claims the 
benefit of priority from the prior Japanese Patent 
Application No. 1 1-333389 , November 24 , 1999, the 
entire contents of which are incorporated herein by 
reference. 

BACKGROUND OF THE INVENTION 

The present invention relates to an improvement in 
a recordable/reproducible information storage medium 
such as a memory card or the like. 

More particularly, the present invention relates 
to an improvement in a removable, portable information 
storage medium suitable for recording/playing back 
digital still image information in combination with 
digital audio information. 

The present invention also relates to a processing 
method of information (still image information, text 
information, or the like, which is associated with 
audio information) recorded on the information storage 
medium. 

Removable, portable information storage media that 
record digital audio information include: 

(A) a CD-DA (compact disc that records digital 
audio in the form of pits); 

(B) a CD-I (CD interactive) or video CD; 
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(C) a DVD (digital versatile disc) video or DVD 
audio disc (phase change recording); 

(D) an MD (a disc using magnetooptical 
recording); and 

5 (E) solid audio (a semiconductor memory card such 

as a flash memory or the like, etc. 

As the shape of the information storage medium 
itself , media (A) to (D) have a disc shape. In these 
G information storage media , a recording layer on each 

jjt 10 medium is irradiated with convergent light of a laser 

beam while rotating the medium, and a change in light 
reflected by the recording layer is detected as a 
playback signal. 

By contrast, medium (E) roughly has a card shape 
15 although various sizes and shapes are available. In 

medium (E), digital audio information is recorded in a 
semiconductor memory (mainly, a flash memory) built in 
a card-shaped body, and a recording/playback process of 
audio information is done via electrode terminals 
2 0 provided to a predetermined portion of the card 

surface. A memory card that belongs to medium (E) is 
used in, e.g., a digital camera. 

In the conventional information storage media 
which has either a disc or card shape, upon editing 
2 5 (dividing, combining, etc. of a tune or music number) 

the recorded audio information (music piece or the 
like), a method of handling various kinds of 
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information (still image information such as a jacket 
image or the like, text information such as words or 
lyric lines or the like) associated with the edited 
audio information (tune or music number) is not 
automated, resulting in troublesome handling for the 
user. 

BRIEF SUMMARY OF THE INVENTION 
The present invention has been made in 
consideration of the above situation and has as its 
object to provide an information storage medium having 
information (attribute information such as a display- 
order mode/display timing mode and the like, a flag 
indicating the presence/absence of still image 
information, and the like) that pertains to handling of 
various kinds of information (still image information 
such as a jacket image or the like, text information 
such as words or the like) associated with audio 
information (tune or music number). 

It is another object of the present invention to 
provide an information playback method using 
information (attribute information such as a display 
order mode/display timing mode and the like, a flag 
indicating the presence/absence of still image 
information, and the like) that pertains to handling of 
various kinds of information (still image information 
such as a jacket image or the like, text information 
such as words or the like) associated with audio 
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information (tune or music number). 

In order to achieve the above object, an 
information storage medium according to the present 
invention has a recording region (121) of audio 
5 information (data of AOB: ATS_xx.AOB) and image 

information (data of IOB: IMG xx.IOB), and has a first 
playback unit (tune or music number) for playing back 
the audio information (ATS_xx.AOB) and a second 

0 playback unit (AOB/TK) having a fineness being equal to 

01 10 or more fine than a fineness of the first playback unit 

(tune or music number). In other words, the second 
(q playback unit (AOB/TK) has a size equal to or smaller 

6s; 

~~ than the first playback unit (tune or music number). 

^ The first playback unit (tune or music number) is made 

[~ 15 up of one or more second playback units (AOB/TK). One 

5 1 

y or more pieces of management information (AOBI/TKI) 

each pertaining to the second playback unit (AOB/TK) 
are recorded in a line (e.g., in music IP in (a) of 
FIG. 10, a sequence of AOBI#2, A0BI#3, and A0BI#4). 
20 Note that display mode information (51, 52) 

indicating a display method (display order, display 
timing) of the image information (IMG_xx.I0B) is 
described in management information (e.g., A0BI#2 in 
music #0 in FIG. 10) recorded at the head position in 
25 the first playback unit (tune or music number) of those 

recorded in a line in the second playback unit 
(AOB/TK) . 
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In order to achieve the above object, an 
information playback method according to the present 
invention plays back information from a medium (100, 
170) that records audio information (data of AOB: 
5 ATS_xx.A0B) and image information (data of IOB: 

IMG_xx.IOB) in a first playback unit (tune or music 
number) for playing back the audio information 
(ATS_xx.AOB) and a second playback unit (AOB/TK) having 
a size equal to or smaller than the first playback unit 

10 (tune or music number). 

When pieces of management information (AOBI/TKI) 
each pertaining to the second playback unit (AOB/TK) 
are recorded in a line (e.g., in music #P in FIG. 10, 
AOBI#2 to AOBI#4) in the medium in which the first 

15 playback unit (tune or music number) is made up of one 

or more second playback units (AOB/TK) (NO in step 
ST1002 in FIG. 25), the contents (e.g., IPI of AOBI#2 
in music #P in FIG. 10) of the management information 
recorded at the head position in the first playback 

20 unit (tune or music number) are used as valid 

information (step ST1006). The image information 
(IMG_xx.IOB) is played back (step ST1018) by accessing 
the image information (IMG_xx.IOB) on the basis of the 
contents (IPI of AOBI#2 in music #P) of the valid 

25 management information (step ST1016). 

Additional objects and advantages of the invention 
will be set forth in the description which follows, and 



in part will be obvious from the description , or may be 
learned by practice of the invention. The objects and 
advantages of the invention may be realized and 
obtained by means of the instrumentalities and 
combinations particularly pointed out hereinafter. 
BRIEF DESCRIPTION OF THE SEVERAL VIEWS OF THE DRAWING 

The accompanying drawings , which are incorporated 
in and constitute a part of the specification, 
illustrate presently preferred embodiments of the 
invention, and together with the general description 
given above and the detailed description of the 
preferred embodiments given below, serve to explain the 
principles of the invention. 

FIG. 1 shows views for explaining a case wherein a 
plurality of music numbers (tunes) with still images, 
the total of which is equal to or smaller than a 
predetermined value (20 images in this case), and which 
are recorded on an information storage medium (memory 
card or disc) according to an embodiment of the present 
invention, are combined by editing. 

FIG. 2 shows views for explaining a case wherein a 
plurality of music numbers (tunes) with still images, 
the total of which exceeds a predetermined value (20 
images in this case), and which are recorded on an 
information storage medium (memory card or disc) 
according to an embodiment of the present invention, 
are combined by editing, and a case wherein the 



combined music number (or combined tune) is divided. 

FIG. 3 shows views for explaining the way in which 
display mode information of the combined music number 
(or combined tune) is handled when a plurality of music 
numbers (or tunes) with still images recorded on the 
information storage medium (memory card or disc) are 
combined by editing. 

FIG. 4 shows views for explaining the way in which 
display mode information and text information of 
divided music numbers (or divided tunes) are handled 
when a music number (or tune) with still images 
recorded on the information storage medium (memory card 
or disc shown) is divided by editing. 

FIG. 5 shows views for explaining the data 
structure (recording format) of a memory card as an 
information storage medium according to an embodiment 
of the present invention. 

FIG. 6 shows views for explaining the recording 
format of an optical disc as an information storage 
medium according to another embodiment of the present 
invention. 

FIG. 7 shows a view for explaining the directory 
configuration (hierarchical structure of recorded 
files) of various kinds of information stored in the 
information storage medium shown in FIG. 5 or FIG. 6. 

FIG. 8 shows views for explaining an example of 
the playback relationships (arrows in FIG. 8) between a 
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plurality of music numbers (or tunes) and still images 
appended to these music numbers , which are stored in 
the information storage medium shown in FIG* 5 or 
FIG. 6. 

5 FIG. 9 shows views for explaining another example 

of the playback relationships (arrows in FIG. 9) 
between a plurality of music numbers (or tunes) and 
still images appended to these music numbers, which are 

Q stored in the information storage medium shown in 

m 10 FIG. 5 or FIG. 6. 

in 

yg FIG. 10 shows views for explaining an example of 

rQ the way in which a jacket image or the like of each 

™" music number (or each tune) is displayed when audio 

□ 

,fi information with still images recorded on the medium 




according to an embodiment of the present invention is 
played back in units of music numbers (in units of 



tunes) or in units of play lists. 

FIG. 11 shows views for explaining an example of 
the way in which jacket images of respective PGCs are 

20 displayed when audio information with still images 

recorded on the medium according to an embodiment of 
the present invention is played back in units of 
program chains (PGCs) or in units of play lists. 

FIG. 12 shows views for explaining another example 

25 of the way in which jacket images of respective music 

numbers (or tunes) are displayed when audio information 
with still images recorded on the medium according to 
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an embodiment of the present invention is played back 
in units of music numbers (in units of tunes) or in 
units of play lists. 

FIG. 13 shows are views for explaining an example 
5 of the playback relationship (arrows in FIG. 13) 

between a plurality of music numbers (or tunes) stored 
in the information storage medium of FIG. 5 or FIG. 6, 
and text (characters, symbols, figures, and/or marks) 
O appended to these music numbers. 

0j 10 FIG. 14 shows views for explaining another example 

y3 of the playback relationship (arrows in FIG. 14) 

if! 

ffi between a plurality of music numbers (or tunes) stored 

yy 

B in the information storage medium of FIG. 5 or FIG. 6, 

Q 

,n and text (characters, symbols, figures, and/or marks) 

C 15 appended to these music numbers. 

FIG. 15 shows views for explaining still another 
example of the playback relationship (arrows in FIG. 
15) between a plurality of music numbers (or tunes) 
stored in the information storage medium of FIG. 5 or 
20 FIG. 6, and text (characters, symbols, figures, 

and/or marks) appended to these music numbers. 

FIG. 16 shows views for explaining the data 
structure of an image object set information 
(IOBSI.IFO) file recorded on the information storage 
25 medium according to an embodiment of the present 

invention. 

FIG. 17 shows views for explaining the data 
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structure of management information (26*) of still 
image ID information in the image object set 
information (IOBSI.IFO) file shown in FIG. 16. 

FIG. 18 shows views for explaining the data 
5 structure of bitmap information (27) of a still image 

file designated as a representative image, jacket 
image, or the like in image object set information 
(IOBSI.IFO) in FIG. 16. 
O FIG. 19 shows views for explaining the data 

m 10 structure of management information that pertains to 

yg each image object (IMG_xx.IOB) in the image object set 

in 

m information (IOBSI.IFO) in FIG. 16. 

W 

FIG. 20 shows views for explaining the data 
^ structure of image pointer information ( IPI ) shown in 

'f' 15 FIGS. 1 to 4, FIGS. 10 to 12 , etc. 

y FIG. 21 shows a view for explaining the playback 

relationship (broken arrows in FIG. 21) between a 
plurality of music numbers (or tunes) and still images 
appended to these music numbers when cell information 

20 (CI#) in FIG. 10 and the like is changed to read a 

track search pointer (DPL_TK_SRP# ) , audio object 
information (AOBI#) in FIG. 10 and the like is changed 
to read track information (TKI#), and image pointer 
information (IPI#) in FIG. 10 and the like is changed 

25 to read a track information search pointer 

(TKI_IOB_SRP) for an image object. 

FIG. 22 shows views for explaining an example of 
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the format (data structure) when encrypted audio 
information is recorded on the audio card with the copy 
protection function shown in FIG. 5. 

FIG, 23 shows a block diagram for explaining an 
5 example of the arrangement for recording information or 

playing back information on or from the audio card with 
the copy protection function shown in FIG. 5. 

FIG. 24 shows a flow chart for explaining the 
sequence of a mutual authentication process and cipher 
10 key (encryption key) exchange process done between the 

audio card in FIG. 5 (or optical disc shown in FIG. 6) f 
Ej and the recording/playback apparatus shown in FIG. 23. 

FIG. 25 shows a flow chart for explaining the 
method of making only an image pointer (IPI) of the 
15 first AOBI (TKI) in a music number or tune (track) 

valid as a pointer of a still image to be displayed 
when the music number or tune (track) is made up of a 
plurality of pieces of AOBI (TKI). 

FIG. 26 shows a flow chart for explaining the 
2 0 method of matching the display order mode/still image 

display timing mode of divided music numbers (or 
divided tunes) with those before the dividing process , 
matching text information associated with the divided 
music numbers with that before the dividing process, 
2 5 and copying all kinds of still image information and 

text information in newly created AOBI (TKI) from the 
same kinds of information of AOBI (TKI) older than the 
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new AOBI (TKI) . 

FIG. 27 shows a flow chart for explaining the 
method of matching the display order mode/still image 
display timing mode of the combined music number (or 
combined tune) with those to be played back first by 
merging still image information in a succeeding music 
number (or succeeding tune) with that in a preceding 
music number (or preceding tune) when two music numbers 
or two tunes (tracks) are combined to generate a new 
music number or new tune (track). 

FIG. 28 shows a flow chart for explaining the 
method of displaying jacket images using still image 
information of a music number or tune (track) included 
in a selected play list or a selected music 
number/ selected tune (track) when a play list or music 
number /tune (track) is selected. 

DETAILED DESCRIPTION OF THE INVENTION 

Various embodiments of the present invention will 
be described hereinafter with reference to the 
accompanying drawings . 

FIG. 1 shows views for explaining a case wherein a 
plurality of music numbers (tunes) with still images , 
the total of which is equal to or smaller than a 
predetermined value (20 images in this case), and which 
are recorded on an information storage medium (memory 
card or disc) according to an embodiment of the present 
invention, are combined by editing. 



As shown in (a) of FIG. 1, music #a and music #P 
are managed by pieces of audio object information 
A0BI#1 (or track information TKI#1) and AOBI#2 (or 
track information TKI#2) as different music numbers or 
different tunes. These A0BI#1 (TKI#1) and AOBI#2 
(TKI#2) respectively have image pointer information 
IPI, and are managed by audio object set information 
AOBSI. 

As shown in (a) and (b) of FIG. 1, an audio 
information file (audio object ATS_01.AOB) including 
the contents of music #a is designated by AOBl#l, and 
still image files (image objects IMG_01.IOB and 
IMG_02.IOB) displayed upon playing back this music #a 
are designated by image pointer information IPI of 
A0BI#1 (TKI#1) . 

Also, as shown in (a) and (b) of FIG. l f an audio 
information file (audio object ATS_02.AOB) including 
the contents of music #p is designated by AOBI#2 
(TKI#2), and still image files (image objects 
IMG_03.IOB and IMG_04.IOB) displayed upon playing back 
this music #P are designated by image pointer 
information IPI of AOBI#2. 

Since the capacity of the information storage 
medium (or the image buffer size of an apparatus that 
plays back the medium) which stores the audio object 
(ATS_xx.AOB) and image objects ( IMG_jyy . IOB) in (b) of 
FIG. 1 is limited, the number of still images that can 
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be displayed per music number (or per tune) has an 
upper limit. 

This upper limit is set to fall within the range 
from around 5 to 100 images in correspondence with the 
5 storage capacity of the medium (or the image buffer 

size of the playback apparatus). 

A case will be examined below wherein the playback 
apparatus can display a maximum of 20 still images per 
music number (tune). 
10 Furthermore, the example shown in FIG. 1 assumes a 

case wherein the total of the number of still images of 
music #a and that of music #P is 20 or less. 

Assume a case wherein the user issues an 
instruction for combining music #a and music #(3 into a 
15 single music #y (i.e., makes combining edit). 

In this case, the two audio information files 
(ATS_01.AOB and ATS_02.AOB) remain unchanged, and only 
management information (A0BI/TKI#1 and AOBI/TKI#2) is 
rewritten . 

20 That is, of information of a program chain 

(original PGC) indicating the original flow of audio 
programs, the contents of information corresponding to 
image pointer IPI of A0BI#1 (TKI#1) and AOBI#2 (TKI#2) 
are partially rewritten, and the rewritten information 

25 (IPI) is re-defined as a portion of music #y. 

The information (IPI) to be written corresponds to 
IPI# in AOBI# in (c) of FIG. 8 or IPI# in cell 
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information CI# in (b) of FIG. 9 to be described later. 

When music #a with still images and music #(3 with 
still images with the configuration shown in (a) and 
(b) of FIG. 1 (these music numbers will be referred to 
5 as previous objects in preceding tracks) are combined, 

single music #y with still images (this music number 
will be referred to as a succeeding object located in 
the next track) is obtained, as shown in (c) of FIG. 1. 

0 In this case, as shown in (c) and (d) of FIG. 1, 

01 10 ATS__01.AOB is designated by AOBI#l (TKI#1) included in 
yg combined music #y, and ATS_02.AOB is designated by 

03 AOBI#2 (TKI#2) included in combined music #y. 

J" Furthermore, all image objects (IMG_01.IOB to 

.7j IMG_04.IOB) are designated by only image pointer IPI of 

H 15 AOBl#l (TKI#1) included in music #y. 

J? More specifically, when "music numbers or tunes 

are combined" , the designation contents of image 
pointer information IPI in AOBl#l (TKI#1) before 
combining and those of image pointer information IPI in 

2 0 A0BI#2 (TKI#2) before combining are recorded together 

in image pointer information IPI of management 
information (A0BI/AKI#1) corresponding to an audio 
information file (ATS_01.AOB) which is played back 
first in music #y. 

25 In other words, the management information 

(AOBI/TKI) of music #y is obtained by merging the 
management information (AOBl/TKI#l) of music #a and the 



management information (AOBl/TKI#2) of music #3* 

As for pointer information IPI that designates 
still images of music #y, only pointer information that 
belongs to the first management information 
(AOBl/TKI#l) of those (AOBI/AKI) of music #y is made 
valid. 

That is, image pointer information IPI of AOBI#2 
included in music #y is made invalid in this case, and 
is not used to designate image objects (IMG_01.IOB to 
IMG_04 .IOB) . 

In other words, image pointer information IPI of 
AOBI#l corresponding to a portion (ATS_01.AOB) which is 
played back first upon playing back combined music #y 
can designate all image objects (IMG_01.IOB to 
IMG_04.IOB). This is a significant feature of the 
embodiment shown in FIG. 1. 

As a result, upon playing back combined music #y, 
the management information (IPI) of AOBI#2 shown in (c) 
of FIG. 1 need not be temporarily saved in a memory 
(RAM) in system controller 3020 of an apparatus shown 
in FIG. 23 (to be described later). 

A memory save can be attained in this way, while 
when only management information AOBI#l in (c) of 
FIG. 1 is temporarily saved in the memory (RAM) of 
system controller 3020, all still image file names that 
can be displayed upon playing back music #y can be 
detected from that information, and the switching 



timing of each still image file (the position of an 
audio frame at which a still image is switched when it 
is played back) can also be detected. 

As a result , the required memory size of the RAM 
in system controller 3020 in FIG. 23 can be reduced, 
and the manufacturing cost of the apparatus can also be 
reduced accordingly . 

FIG. 2 shows views for explaining a case wherein 
a plurality of music numbers (tunes) with still images, 
the total of which exceeds a predetermined value (20 
images in this case), and which are recorded on an 
information storage medium (memory card or disc) 
according to an embodiment of the present invention, 
are combined by editing, and a case wherein the 
combined music number is divided. 

Note that FIG. 2 does not illustrate TKI 
corresponding to AOBI . However, since AOBI corresponds 
to TKI as in FIG. 1, TKI will be inserted as needed in 
parentheses in the following description. 

When 11 to 2 0 still image files are set by each of 
AOBI#l (TKI#1) and AOBI#2 (TKI#2) in (a) of FIG. 1, the 
total number of still images after "combining music 
numbers /combining tunes" exceeds the upper limit 
(20 images) per music number (per tune). A processing 
method in such case will be explained below with 
reference to FIG. 2. 

After a plurality of music numbers ( #a and #0 in 



(a) of FIG. 2) are combined, when the total number 
of still images of the combined music ( #y in (b) of 
FIG. 2) exceeds the number (20 images) of displayable 
still image per music number (per tune), system 
controller 3020 in FIG. 23 to be described later 
appropriately shuffles information (image pointers 
after overlapping portions for identical still images 
are rejected) recorded in image pointer information 
IPI#1 and image pointer information IPI#2 in (a) of 
FIG. 2. 

For example, system controller 3020 selects 20 
image pointers of those of shuffled 20 or more still 
images in turn from the first one, thus choosing still 
images to the number of displayable images (20 images) 
per combined music number/combined tune (#Y). 

As shown in (c) of FIG. 2, the chosen 20 still 
images are recorded in image pointer information IPI#1' 
of A0BI#1 (TKI#1) of combined music #y, and non- 
selected still images (extra images exceeding 20 
images) are recorded in image pointer IPI#2' of AOBI#2 
(TKI#2) to be played back later in single music #y. 

Then, still images to be displayed upon playing 
back music #y after music #a and music #P are combined 
are only (20) still images designated within image 
pointer IPI#1' present in management information 
(A0BI#1) that pertains to the audio information file 
which is played back first in music #y. 



When the user is dissatisfied with still images 
selected by system controller 3020 in FIG. 23 in a 
combining process of music #y, he or she can exchange 
information between image pointer information IPI#1' 
and image pointer information IPI#2' using still image 
designation information (image pointer) recorded in 
image pointer information IPI#2* not selected (i.e., 
which is rejected and is tentatively invalid). 

Information exchange between image pointer 
information IPI#1' and image pointer information IPI#2* 
can be done by an information recording/playback 
apparatus (multi-function editor) with advanced edit 
functions or a personal computer PC installed with 
required application programs. 

Likewise , when music #y with 20 or less display 
images (IPI#1') and rejected images (IPI#2') exceeding 
20 images, and music #r| with 20 or less display images 
(IPI#3) and rejected images (IPI#4) beyond 20 images 
are combined again, and the total number of still 
images to be displayed exceeds the predetermined value 
(20), display images (IPI#1 M ) of re-combined music #0 
are 2 0 images selected after information of image 
pointer information IPI#1' and information of image 
pointer information IPI#3 are shuffled. 

Information (image pointers) indicating other 
rejected images is recorded in image pointer 
information IPI#2 , / image pointer information IPI#3', 



and image pointer information IPI#4 of A0BI#2, A0BI#3, 
and AOBI#4. 

At this time information (image pointers) in each 
of image pointer information IPI#2' and image pointer 
information IPI#4 remains unchanged. This is because 
still images designated in image pointer information 
IPI#2* and image pointer information IPI#4 respectively 
have links to the contents of audio information files 
managed by AOBI#2 and AOBI#4. 

As shown in (b) and (c) of FIG, 2, when music #0 
is obtained by combining music #y and music #r\, if 
information (image pointers to rejected images) in 
image pointer information IPI#2 1 and IPI#4 remains 
unchanged, the user can choose still images that match 
divided audio information (the contents of divided 
music numbers or divided tunes) by re-editing using the 
multi-function editor or personal computer PC after 
music #0 is divided in future. 

If no re-edit is done, rejected images designated 
by image pointer information IPI#2 , / image pointer 
information IPI#3', and image pointer information IPI#4 
in (c) of FIG. 2 are displayed neither upon playback of 
music #0 nor upon playback of music numbers ( #i and #k 
in (d) of FIG. 2) obtained by dividing music #0. 

A processing method upon dividing music #0 (which 
is assumed to be a previous object in a preceding 
track) into two music numbers will be explained below. 
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A case will be examined below wherein music #9 is 
divided into music #i and music #k (assumed to be new 
objects created on new tracks) in, e.g., the middle of 
A0BI#3 (TKI#3) in (c) of FIG. 2. 
5 In this case, an audio information file 

corresponding to AOBI#3 (TKI#3) is divided into two 
files. From management information AOBI#3 before the 
dividing process, AOBI#5 (TKI#5) ((d) of FIG. 2) 
O corresponding to an audio information file to be played 

gl 10 back last in divided music #i is created, 

yd Still image information to be displayed during 

m playback of divided music #i is designated by image 

IT pointer information IPI#l"((d) of FIG. 2) in AOBI#l 

*S (TKI#1) corresponding to an audio information file to 

[7 15 be played back first in music #i. 

2 At this time, AOBI#l (TKI#1) in (d) of FIG. 2 has 

the same image pointer information IPI#1" as that of 
AOBI#l (TKI#1) in (c) of FIG. 2. That is, information 
of image pointer information IPI#1" before the dividing 

20 process shown in (c) of FIG. 2 is directly copied to 

AOBI#l (TKI#1) in (d) of FIG. 2. 

Likewise, from management information AOBI#3 
(TKI#3) before the dividing process, AOBI#6 (TKI#6) 
((d) of FIG. 2) corresponding to an audio information 

25 file to be played back first in divided music #k is 

created. Still picture information to be played back 
during playback of music #k is designated by image 



pointer information IPI#1" ((d) of FIG. 2) in AOBI#6. 

At this time, A0BI#6 (TKI#6) in (d) of FIG. 2 has 
the same image pointer information IPI#1" as that of 
A0BI#1 in (c) of FIG. 2. That is, information of image 
pointer information IPI#1" before the dividing process 
shown in (c) of FIG. 2 is directly copied to A0BI#6 
(TKI#6) in (d) of FIG. 2. 

Since the number of display images of music #9 
before the dividing process has been limited to 20 in 
the previous process, if image pointer IPI#1 M having 
information (image pointers ) that point to these 20 
images is directly copied to divided music #t and music 
#k, no problem is posed in terms of the number of still 
images to be displayed. 

Note that image pointer information IPI#1 M copied 
to display still images upon playing back music #k may 
have contents which do not match AOBI#6 (TKI#6). In 
this case, the user can change the contents (image 
pointers) of image pointer information IPI#1" to those 
which match the contents (audio information designated 
by AOBI/TKI#6) of divided music #k by re-editing them 
using the multi-function editor or personal computer 
PC. 

The combining/dividing method for music number 
described with reference to FIGS. 1 and 2 is a 
processing method complying with the data structure 
shown in FIG. 8 to be described later. However, the 



present invention is not limited to such specific 
method, and the music number combining/dividing process 
of FIGS . 1 and 2 may be executed in accordance with the 
data structure shown in FIG. 9 to be described later . 

Note that image pointer information IPI is 
recorded not in audio object information AOBI (TKI) 
but in cell information CI when the music number/tune 
combining/dividing process is executed in accordance 
with the data structure shown in FIG. 9. 

Furthermore , the aforementioned image pointer 
information IPI forms a part of all kinds of 
information that pertain to still picture objects. 

FIG. 3 shows views for explaining the way in which 
display mode information of the combined music number 
is handled when a plurality of music numbers with still 
images recorded on the information storage medium 
(memory card or disc) are combined by editing. 

Note that the subsequent figures do not describe 
TKI corresponding to AOBI , but TKI corresponds to AOBI 
as in FIG. 1 or FIG. 2. 

A method of setting a jacket image in units of 
music numbers (in units of tunes) or setting a 
representative image of a given music number (given 
tune) upon a "music combine/tune combine" process will 
be explained below using FIG. 3. 

A case will be examined below wherein a single 
still image (IMG_02.IOB) is displayed upon playing back 



music #a before the combining process , and two still 
images (IMG_03.IOB and IMG_04.IOB) are displayed upon 
playing back music #5. (These music #ct and music #5 
are assumed to be previous objects located on preceding 
tracks. Also, combined music #e is assumed to be a 
succeeding object located in the next track. ) 

Upon playing back music #ot, IMG_02.IOB is 
displayed as a representative image of that music 
number. However, since IMG_03.IOB is displayed first 
upon playing back music #5, IMG_03.IOB is set as a 
representative image of music #5. 

Representative images shown in (b) of FIG. 3 can 
be used as some (or all) of jacket images for music #ct 
or music #5, or can be used as some (or all) of jacket 
images for the entire medium (a card shown in FIG. 5 or 
a disc shown in FIG. 6) that records these music 
numbers . 

After the combining process, as shown in (c) and 
(d) of FIG. 3, AOBI#l and A0BI#7 themselves remain 
unchanged, and ATS_01.AOB and ATS_07.AOB as audio 
information files also remain unchanged. However, all 
pieces of information that pertain to still pictures 
are concentrated in IPI#1 in AOBI (TKI) #1 as 
management information for audio information file 
ATS_01.AOB to be played back first in music #6 together 
with display mode information indicating the display 
order/display timings of one or more still images and 



jacket image setting information or representative 
image setting information. 

The display order is IMG__02.IOB, IMG_03.IOB, and 
IMG_04.IOB in correspondence with that before the 
combining process shown in (a) of FIG. 3. (This 
display order or display sequence can be specified by 
display mode information to be described later with 
reference to FIG. 10 or FIG. 20.) 

As a representative image (or jacket image) for 
combined music #s, IMG_02.IOB to be displayed first is 
automatically set. 

In the configuration shown in FIG. 3, IMG_02.IOB 
to IMG_04.IOB including an image object set as the 
representative image can be used not only as a jacket 
image of music #e, but also as word cards including 
images of words (text information) of that music 
number . 

The display order and display timings of one or 
more jacket images or word cards can be determined by 
display mode information (51, 52) in FIG. 20. 

Furthermore, the display timings of one or more 
jacket images or word cards can be determined in 
synchronism with audio frames (transfer units of audio 
data) in (c) of FIG. 22. In this way, words can be 
displayed while being switched along with the progress 
of song. 

Note that display mode information (FIG. 10, 
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FIG. 20) of still images (jacket image , word cards, and 
the like) of music #e is recorded in the first AOBI 
(first TKI) of music #e. In music #8, only this first 
AOBI (first TKI) is valid (for still image display 
5 control ) . 

FIG. 4 shows views for explaining the way in which 
display mode information, text information, and the 
like of divided music numbers are handled when a music 
Q number with still images recorded on the information 

01 10 storage medium (a card shown in FIG. 5 or a disc shown 

fcO in FIG. 6) is divided by editing. 

m 

go A method of setting a jacket image in units of 

s - ; 
5 = ; 

~~ music numbers (in units of tunes) or setting a 

Jji representative image of that music number (tune) upon a 

fT 15 "dividing music number (dividing tune)" process will be 

™ explained below using FIG. 4. 

Assume that one still image IMG_02.IOB is 
displayed upon playing back music #a ((a) of FIG. 4) 
before the dividing process, and IMG_02.IOB is set as a 
2 0 representative image (or jacket image) indicating the 

contents of this music #ot. 

When music #a in (a) of FIG. 4 is divided into 
music #a and music by the music number dividing 
process, as shown in (c) of FIG. 4, original audio 
2 5 object information (A0BI#1 in (a) of FIG. 4 is divided 

into AOBI#l and AOBI#8 ((c) of FIG. 4). Also, as shown 
in (d) of FIG. 4, the audio information file is divided 
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into ATS_01.AOB and ATS_08.AOB in accordance with the 
dividing situation . 

At this time, the contents of text pointer 
information TPI#1 and image pointer information IPI#1 
5 in A0BI#1 before the dividing process are directly 

copied to TPI#1 and IPI#1 in AOBI#l and TPI#8 and IPI#8 
in AOBI#8 after the dividing process. 

As a result, IMG_02.IOB ((d) of FIG. 4) is 
Q designated as the representative images or jacket 

yl 10 images (or word cards including word text) for both 

y i 

y3 music #a and music #£. 

gi The aforementioned text pointer information TPI 

forms a part of all kinds of information that pertain 
IS to text . 

f7 15 FIG. 5 shows views for explaining the data 

y structure (recording format) of information recorded in 

audio card (memory card) 100 as an information storage 
medium according to an embodiment of the present 
invention. 

2 0 The information storage medium (audio card/memory 

card) shown in FIG. 5 has a card shape as large as the 
size of a name card, a stick of gum, or a stamp, and 
comprises electrodes (not shown in FIG. 5) for 
connecting an external apparatus (not shown in FIG. 5) 

25 at a predetermined position on the outer side of card 

100. As will be described later, information is 
input /output from/ to an information playback apparatus 
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or information recording/playback apparatus ( see 

FIG. 23) using card 100 in FIG. 5 via these electrodes. 

The main body of this audio card/memory 100 
comprises a semiconductor IC prepared by assembling a 
5 microcomputer and its peripheral devices in a 64MB 

flash memory (EEPROM) . 

As shown in (a) of FIG. 5, audio card 100 has a 
copy protection function, and can prevent illicit copy 
or use of information recorded in audio card 100. 
10 That is, with respect to an external apparatus 

(information playback apparatus or information 
recording/playback apparatus), audio card 100 itself 
(A) makes mutual authentication and cipher key 
(encryption key) exchange, 



B 

15 (B) inputs and outputs encrypted information, and 



(C) allows only a partner (information playback 
apparatus or information recording/playback apparatus) 
authenticated by audio card 100 to use correct 
( decrypted ) information . 
20 Such mutual authentication, cipher key (encryption 

key) exchange, encryption/decryption (decipher) of 
information, and information I/O interface process are 
executed by control CPU (MPU) 101 in the audio card. 

A program executed by control CPU 101 in the audio 
25 card is stored in authentication/key exchange & I/O 

process related control program recording ROM 102. 
In the information playback apparatus or 



information recording/playback apparatus (see FIG. 23), 
authentication/identification is done for each audio 
card 100 to manage security of information transferred 
and input to each card 100. 

As a security means for information management in 
units of cards done by the information 
recording/playback apparatus, audio card 100 has a 
unique ID, and can set a unique cipher key. 

That is, the unique ID (the manufacturer name, 
product name, lot number, serial number, or the like) 
assigned to each audio card 100 and unique cipher key 
(encryption key) information are recorded in card 
unique ID information & key information recording 
region (RAM) 103. 

Audio card 100 with the copy protection function 
also has application data recording region (RAM) 104, 
which can record audio information (audio object AOB), 
still image information (image object IOB), text 
information (text object TOB), management information 
(AOBSI.IFO, IOBSI.IFO, and TOBSI.IFO in FIG. 7) that 
manages those information, and the like. 

As shown in (b) of FIG. 5, application data 
recording region (RAM) 104 is made up of boot 
information recording region 110, file allocation table 
(FAT) recording region 111, root directory information 
recording region 112, and data region 113. 

That is, the file format of data recorded in 



application data recording region (RAM) 104 adopts the 
FAT format. 

When audio card 100 with the copy protection 
function shown in FIG. 5 is inserted into the 
information recording/playback apparatus (see FIG. 23), 
the information recording/playback apparatus reads 
information recorded in boot information recording 
region 110, and automatically boots (activates) itself. 

After that, when the information 
recording/playback apparatus plays back desired 
information (music, still images, and the like) from 
card 100, it reads file allocation information in FAT 
recording region 111 to detect the storage address of 
desired information to be played back, and accesses 
application data recording region (RAM) 104 based on 
the detected address. 

In data region 113, audio related information 
recording region 121 and one or more general computer 
information recording regions 120 can be arbitrarily 
set together, as shown in (c) of FIG. 5. 

As shown in (d) of FIG. 5, audio related 
information recording region 121 is comprised of 
management information recording region 130, audio 
object (AOB) recording region 131, image object (IOB) 
recording region 132, and text object (TOB) recording 
region 133. 

Audio information recorded in audio card 100 is 



stored in AOB recording region 131 , still image 
information recorded in audio card 100 is stored in IOB 
recording region 132, and text information recorded in 
audio card 100 is stored in TOB recording region 133. 

On the other hand, management information (map 
information or the like) that pertains to these audio 
information, still image information, and text 
information, and management information (search 
pointers or the like) indicating links among 
information are stored in management information 
recording region 130. 

This management information recording region 130 
is divided into four recording regions, as shown in (e) 
of FIG. 5. 

That is, management information recording region 
130 is made up of program chain set information (PGCSI) 
recording region 140, audio object set information 
(AOBSI) recording region 141, image object set 
information (IOBSI) recording region 142, and text 
object set information (TOBSI) recording region 143. 

PGCSI recording region 140 is formed of original 
PGC (ORG_PGC) information recording region 150 for 
storing information of an original program chain, and 
one or more user-defined PGC (UD_PGC) recording regions 
151, 152,..., for storing information of new program 
chains defined by the user in use of card 100, as shown 
in (f) of FIG. 5. 
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ORG_PGC information recording region 150 is 
comprised of recording region 160 of information 
indicating the total number of cells (information units 
that form a PGC) present in the original PGC, and one 
or more cell information (CI) recording regions 161, 
162,..., as shown in (g) of FIG. 5. 

In audio card (memory card) 100 with the 
aforementioned data structure, the recorded contents 
such as music information, and the like are stored at 
corresponding locations in recording regions 131 to 133 
in (d) of FIG. 5. 

Also, management information (a method of playing 
back an edited music number (edited tune) and 
corresponding images /text, and the like) after the user 
has edited the stored recorded contents (e.g., 
processes for combining music number, dividing music 
number, erasing music number, moving music number, and 
so on) is stored at a corresponding location in 
recording region 130 in (d) of FIG. 5. 

In the embodiment of the present invention, as 
memory card 10 0 with the copy protection function shown 
in FIG. 5, an audio card that records audio 
information/ image information/text information 
protected from illicit copy/illicit use is assumed. 

However, memory card 100 shown in FIG. 5 can be 
used to record not only such audio information but also 
application files (or PC data) such as a wordprocessor , 
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spreadsheet, and the like used in general personal 
computer PC (a recording region for such data is 
denoted by 120 in (c) of FIG. 5). 

In this case, using the authentication/key 
exchange & I/O related control program stored in ROM 
102 and card unique ID and key information stored in 
RAM 103 in (a) of FIG. 5 as needed, application files 
(or PC data) such as a wordprocessor , spreadsheet, 
game, and the like can be prevented from being 
illicitly copied/used. 

That is, memory card 100 shown in FIG. 5 can be 
used as package media that distribute computer programs 
(application programs, game programs, and the like) to 
be protected from illicit copy/use (for pay or free). 

FIG. 6 shows views for explaining the recording 
format of an optical disc as an information storage 
medium according to another embodiment of the present 
invention . 

Audio card (memory card) 100 shown in (a) of FIG. 
5 is a card-shaped medium which does not move itself in 
use, but disc-shaped medium 170 shown in (a) of FIG. 6 
itself rotates in use. 

As an example of recordable/reproducible disc- 
shaped medium 17 0, a hard disc drive HDD (especially, 
HDD using a removable recording medium) , large-capacity 
floppy disc drive FDD (recently, FD with a capacity of 
100 MB or more is commercially available), 
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magnetooptical MO, DVD-RAM, DVD-R, DVD-RW, and the like 
are known . 

The file format of the HDD or MO adopts the FAT 
format that has been explained with reference to (b) of 
5 FIG. 5, but the DVD-RAM, DVD-R, DVD-RW, and the like 

adopt the universal disc format (UDF) . 

Rewritable data region 1820 in (b) of FIG. 6 has a 
hierarchical data structure shown in (c) to (g) of 
p FIG. 6. This data structure is the same as that which 

0! 10 has already been explained with reference to (c) to (g) 



of FIG. 5. 

Upon accessing information (for example, files in 
the directory structure shown in FIG. 7 to be described 
later) recorded on disc- shaped medium 170, volume & 
15 file structure information 1810 is played back first. 

This volume & file structure information 1810 includes 
UDF information used to access data files shown in 
FIG. 7. 

FIG. 7 is a view for explaining the directory 
20 configuration (hierarchical structure of recorded 

files) of various kinds of information stored in memory 
card 100 in FIG. 5 that adopts FAT or disc-shaped 
medium 170 in FIG. 6 that adopts UDF. 

Information recorded in application data recording 
25 region (RAM) 104 in (a) of FIG. 5 has a hierarchical 

directory structure as shown in FIG. 5, and information 
in root directory 2000 in FIG. 7 is recorded in root 



directory information recording region 112 in (b) of 
FIG. 5. 

Alternatively , information recorded in data region 
1820 in (b) of FIG. 6 has a hierarchical directory 
structure shown in FIG. 7, and information in root 
directory 2 000 in FIG. 7 is recorded in volume & file 
structure information 1810 in (b) of FIG. 6. 

Even when either audio card 100 with the copy 
protection function that adopts the FAT format, as 
shown in FIG. 5, or disc-shaped information storage 
medium 170 that adopts the UDF format, as shown in 
FIG. 6 is used as the information storage medium, 
information recorded in the information storage medium 
is recorded in units of files, as shown in FIG. 7. 

Audio information (AOB) with still images (IOB) 
described with reference to FIGS. 1 and 2 is recorded 
together in subdirectory 2001 named real-time audio 
recording directory 2100, as shown in FIG. 7. 

This real-time audio recording directory 2100 has 
data file 2002 including files 2110 to 2140, 2310, 
2320, 2500,... to be described below as subdirectories. 

Audio information (audio object AOB) recorded in 
the information storage medium shown in FIG. 5 or 
FIG. 6 is recorded in units of files such as ATS_01.AOB 
2500, and the like, as shown in FIG. 7. Details of 
audio object file (audio information file) 2500 will be 
explained later with reference to FIG. 22. 



These audio information files (ATS_01.AOB 
2500,...) are recorded and saved in audio object 
recording region 131 in (d) of FIG. 5 or 6 . 

Image information (image object IOB) recorded in 
the information storage medium shown in FIG. 5 or 
FIG. 6 is recorded as independent files like IMG_01.IOB 
2310, etc., in units of images (still images), as shown 
in FIG. 7. 

These image information files (IMG_01.IOB 
2310,...) are recorded and saved in image object 
recording region 132 in (d) of FIG. 5 or 6 . 

Furthermore, the information storage medium shown 
in FIG. 5 or FIG. 6 can record text information (text 
object TOB) such as words, comments for played music 
numbers (tunes), profiles of a player, and the like in 
units of files like TXT_01.TOB 2320,..., as shown in 
FIG. 7. 

These text information files (TXT_01.TOB 2320, ) 

are recorded and saved in text object recording region 
133 in (d) of FIG. 5 or 6 . 

All pieces of management information that 
pertain to audio information (audio object AOB) 
recorded in audio object recording region 131 are 
recorded together in single file 2120 named AOBSI.IFO, 
as shown in FIG. 7. The recording location of this 
AOBSI.IFO file is audio object set information AOBI 
recording region 141 in (e) of FIG. 5 or 6 . 
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All pieces of management information that pertain 
to still image information (image object IOB) recorded 
in image object recording region 132 are recorded 
together in file 2130 named IOBSI.IFO. The recording 
5 location of this IOBSI.IFO file 2130 is image object 

set information recording region 142 in (e) of FIG. 5 
or 6 . 

Likewise , all pieces of management information 
O that pertain to text information (text object TOB) 

yl 10 recorded in text object recording region 133 are 

03 recorded together in file 2140 named TOBSI.IFO. The 

y i 

recording location of this TOBSI.IFO file 2140 is text 
object set information recording region 143 in (e) of 
FIG. 5 or 6. 

15 Even when the information storage medium has a 

shape of either audio card 100 with the copy protection 
function or disc-shaped information storage medium 170, 
all pieces of management information that indicate the 
playback order of all pieces of audio information (all 
20 AOBs) recorded in the information storage medium are 

recorded together in single file 2110 named PGCSI.IFO, 
as shown in FIG. 7. The recording location of this 
PGCSI.IFO file 2110 is program chain set information 
recording region 140 in (e) of FIG. 5 or 6 . 
25 Note that a program chain (PGC) is made up of one 

or more cells C, as will be described later, and has a 
structure that can define the playback sequence (or 
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playback order) of music numbers (tunes) in the PGC by 
means of the layout order (or arrangement) of cells C, 
as shown in (b) of FIG. 8, or in (g) of FIG, 5 or 6 . 
When data of recordable/reproducible DVD video 
5 (DVD_RTR) is recorded in the data region of the medium 

shown in FIG. 5 or FIG. 6, DVD_RTR directory 2200 
including DVD_RTR data files is assured as a 
subdirectory of root directory 2000 in FIG. 7. 
O When data of DVD audio is recorded in the data 

CP 10 region of the medium shown in FIG. 5 or FIG. 6, DVD 

J3 audio directory 2300 including data files 

m (ATS_01_0.IFO; ATS_0 1__0 . AOB , and the like) of DVD audio 

s is assured as a subdirectory of root directory 2000 

2 shown in FIG. 7. 

15 Furthermore, subdirectory 2400 that manages flags 

'p. indicating the presence/absence of still image data 

(indicating whether still image data are 
recorded/unrecorded) is assured under root directory 
2000 in FIG. 7. 
20 For example, system controller 3020 in FIG. 23 

accesses hierarchical file information in FIG. 7 from 
card 100 in FIG. 5 or disc 170 in FIG. 6, and can read 
the contents (still image data flags; see FIGS. 16 to 
19) of subdirectory 2400 before playback of a music 
25 number (or tune). 

Then, upon accessing the contents (audio objects, 
image objects, text objects, and the like) in real-time 



audio recording directory 2100 in FIG. 7 upon playing 
back a music number (or tune), image objects with 
"unrecorded" flags ("00" in (c) of FIG- 17) can be 
skipped (that is, unwanted access can be avoided from 
being generated). 

Since no unwanted access is generated, and still 
images can be smoothly read (i.e., only required still 
image objects can be quickly accessed) , desired images 
(word card images, and the like) can be played back at 
just timings without being delayed from the flow of 
music number (tune) even when still image data are not 
stored in advance in a buffer memory of the playback 
apparatus . Here , in the example shown in FIG . 1 , a 
maximum of 20 images in unit of music number (or in 
unit of tune) forms the above still image data. 

FIG. 8 shows views for explaining an example of 
the playback relationships (arrows in FIG. 8) between a 
plurality of music numbers (tunes) and still images 
appended to these music numbers, which are stored in 
the information storage medium shown in FIG. 5 or 
FIG. 6. The relationship among respective kinds of 
management information will be explained below using 
FIG. 8. 

In the embodiment of the present invention, all 
pieces of audio information (all AOBs) recorded on the 
information storage medium are managed using units 
called " music numbers (tunes)". 
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Furthermore , music numbers or tunes recorded on 
the information storage medium have information of the 
sequence for successively playing back all music 
numbers (tunes) in turn, and a region where the 
5 sequence information (program chain PGC) which is 

created first is recorded is called original PGC 
(ORG_PGC) information recording region 150 (see (f) of 
FIG. 5, (f) of FIG. 6(f), or (a) of FIG. 8). 
p Management information (AOBSI) that pertains to 

m 10 audio information (AOB) has an independent management 

yg information unit (AOBI#l to AOBI#5) for each audio 

• 5=5 

y i 

m information file (AOB file) like ATS_01.AOB to 

^ ATS 0 5. AOB (each corresponding to ATS_01.AOB 2 50 0 in 

" FIG. 7) shown in (d) of FIG. 8. As such management 

[7 15 information units, pieces of audio object information 

2 AOBI#l, AOBI#2, AOBI#3, AOBI#4, and AOBI#5 are set, as 

shown in (c) of FIG. 8. 

Pieces of audio object information AOBl#l to 
AOBl#5 respectively have pieces of time map information 
20 (TMI) 181 to 185 each including information that 

indicates the relationship between the playback time 
and recording location (address) in the medium to allow 
special playback such as time search, f astf orwarding 
(FF), f astrewinding (FR), and the like. 
25 In the embodiment shown in FIG. 8, pieces of audio 

object information AOBI#l to AOBI#5 include information 
of pieces of image pointer information IPI#1 to IPI#5, 
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which can directly designate still image information 
files IMG_01.IOB to IMG_03.IOB. 

As shown in (b) and (c) of FIG. 8, a size 
designated by pieces of cell information CI#1 to CI#5 
5 defined in original PGC information recording region 

150 has one-to-one correspondence with the total 
playback range indicated by pieces of corresponding 
audio object information AOBI#l to A0BI#5. 

As shown in (b) of FIG. 8, one or more pieces of 
10 cell information CI form each of music #a, music 

and music #y. Information indicating the relationship 
between each cell information CI and a music number 
(tune) is described in pieces of cell information CI#1 
to CI#5. 

15 As described above, the playback order of the 

original PGC is defined by the layout order of 
corresponding cell information CI. but the playback 
sequences in units of music numbers (in units of tunes) 
are described in original PGC information recording 

2 0 region 150 in terms of the relationship with music 

numbers (tunes) shown in (b) of FIG. 8. 

In addition to the playback sequence indicated by 
the original PGC, unique playback sequence information 
set by the user is recorded in user-defined PGC 

25 recording region 151. Pieces of cell information CI#11 

to CI#13 defined in user-defined PGC recording region 

151 have a structure capable of setting corresponding 
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audio object information AOBI (A0BI#3 to A0BI#5 in (c) 
of FIG. 8) and the playback start and end times in time 
map information (TMI 183 to TMI 185 in (c) of FIG. 8) 
defined in the AOBI . 

Therefore, by setting cell information CI in (b) 
of FIG. 8 in turn, an arbitrary playback sequence for 
audio information (audio object AOB) can be defined in 
user-defined PGC recording region 151. 

In the example shown in (b) of FIG. 8, since cell 
information CI#11 designates a portion in time map 
information TMI 185, the playback range of music #y' 
that cell information CI#11 defined in the user-defined 
PGC plays back can play back only a range narrower than 
that of music #y defined in the original PGC. 

As described above, according to the embodiment of 
the present invention, an arbitrary range can be played 
back without being limited by the playback range of a 
music number (tune) defined in the original PGC. 

The user can set a plurality of arbitrary playback 
sequences in user-defined PGC recording region 151. A 
plurality of user-defined PGC recording regions #A151, 
#B*152,... can be defined in units of playback sequences 
designated by the user, as shown in (f) of FIG. 5 or 6. 

In the embodiment shown in FIG. 8, image pointer 
information IPI#2 is set to display two still images 
IMG_02.IOB and IMG_03.IOB during playback of music #(3. 

In the embodiment of the present invention, still 



image file information to be displayed for each music 
number (each tune) is described in image pointer 
information IPI#2 (corresponding to 192 in FIG. 8 or 
197 in FIG. 9) in audio object information (for 
example, corresponding to cell information CI#2 in 
AOBl#2 in music #0) to be played back first in that 
music number. 

FIG. 9 shows views for explaining another example 
of the playback relationships (arrows in FIG. 9) 
between a plurality of music numbers (tunes) and still 
images appended to these music numbers , which are 
stored in the information storage medium shown in FIG. 
5 or FIG. 6. The differences from FIG. 8 will be 
explained below. 

The embodiment shown in FIG. 9 has pieces of 
image object information I0BI#1 and IOBI#2 as 
individual management information for still image 
information files IMG_01.IOB and IMG_02.IOB. 

When one of pieces of image pointer information 
IPI#1 to IPI#3, IPI#13, and IPI#14 points to pieces of 
image object information IOBI#l and I0BI#2, still image 
information files IMG_01.IOB and IMG_02.IOB to be 
simultaneously displayed upon playing back audio 
information are designated. 

Unlike in the embodiment shown in FIG. 8, pieces 
of image pointer information IPI#1 to IPI#3, IPI#13, 
and IPI#14 are respectively set in pieces of cell 
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information CI#1 to CI#3, CI#13, and CI#14. 

In the embodiment shown in FIG. 8, still image 
information files to be displayed upon playing back 
music #y and music #(3' defined in user-defined PGC 
5 recording region 151 match those to be displayed upon 

playing back music #y and music #fJ defined in original 
PGC recording region 150 f and still image information 
files to be displayed upon playback cannot be 
O arbitrarily set (changed). 

ff§ 10 By contrast, in the embodiment shown in FIG. 9, 

yj since image pointer information IPI# is set in each 

in 

m cell information CI#, still image information files to 

^ be displayed upon playback can be arbitrarily set in 

~i units of cells . 

[7 15 FIG. 10 are views for explaining an example of the 

y way in which a jacket image or the like of each music 

number is displayed when audio information with still 
images recorded on the medium according to an 
embodiment of the present invention is played back in 
20 units of music numbers or in units of play lists. 

In the embodiment of the present invention , all 
pieces of audio information (audio objects AOB) 
recorded on the information storage medium are managed 
using units called "music numbers or tunes". 
25 Music numbers (tunes) recorded on the information 

storage medium have sequence information for 
successively playing back all music numbers in turn, 



and a region where this information is recorded is 
called original PGC (original program chain) 
information recording region 150. 

Management information that pertains to audio 
information (AOB) has an independent management 
information unit for each audio information file (AOB 
file) like ATS_xx.AOB (xx is an integer starting from 
01) , and pieces of audio object information (AOBI) #1, 
#2 , #3 , . . . are set . 

Each audio object information AOBI# has time map 
information having relationship information between the 
playback time and recording location (address) to allow 
special playback such as time search , f astf orwarding 
(FF), f astrewinding (FR), and the like. 

Also, audio object information AOBI# can include 
image pointer information IPI#. From this IPI, still 
image information file lMG_xx.IOB (xx is an integer 
starting from 01) is directly designated. 

A size designated by each cell information CI# 
defined in original PGC information recording region 
150 has one-to-one correspondence with the total 
playback range indicated by corresponding audio object 
information AOBI#l. 

Each of music #a, music #P, and music #y is made 
up of one or more pieces of cell information CI#. 
Information indicating correspondence between each CI# 
and a music number (tune) is described in each CI#. 



In this embodiment, the playback order of the 
original PGC is defined by the layout order of 
corresponding CI#. but the playback sequences in units 
of music numbers (in units of tunes) are described in 
original PGC information recording region 150 in terms 
of the relationship with corresponding music numbers 
(tunes ) . 

In addition to the playback sequence indicated by 
the original PGC, unique playback sequence information 
set by the user is recorded in user-defined PGC 
recording region 151. 

Cell information CI# defined in user-defined PGC 
recording region 151 has a structure capable of setting 
corresponding audio object information AOBI and the 
playback start and end times in time map information 
defined in the AOBI. 

Hence, by setting CI# in turn, an arbitrary 
playback sequence for audio information (AOB) can be 
defined in user-defined PGC recording region 151. 

Since cell information CI# designates a portion in 
time map information, the playback range of music # 
that CI# plays back can play back a range narrower than 
that of corresponding music #y defined in the original 
PGC. 

In this way, an arbitrary range can be played back 
without being limited by the playback range of a music 
number (tune) defined in the original PGC. 
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The user can set a plurality of arbitrary playback 
sequences in user-defined PGC recording region 151, and 
a plurality of user-defined PGC (program chain) 
recording regions #A, #B, . . . can be defined in units of 
5 playback sequences designated by the user. 

As shown in (a) of FIG. 10 , recording region 140 
(see FIG. 5) of program chain set information (PGCSI) 
has recording region 150 of the original PGC (ORG_PGC) 

0 and recording region 151 of one or more user-defined 

01 10 PGCs (UD_PGC#A). 

Ul 

J3 In this case, music #a, music #P, and music #y are 

m 

jg recorded in 0RG_PGC recording region 150, and music #0 

LaJ 

l" and music #y are recorded in UD_PGC#A recording region 

« 151. 

n 15 A PGC (program chain) is made up of one or more 

y cells C, and the playback sequence (playback order) of 

music numbers (tunes) in the PGC can be defined by the 
layout order of these cells. 

Music #a in ORG_PGC recording region 150 has cell 
20 information CI#1 including text information TXI#1 (text 

information including text pointer information TPI# 
shown in FIG. 4 or FIGS. 13 to 15) and image pointer 
information IPI#1. This IPI#1 designates management 
information of still image IMG_02.IOB included in 
25 recording region 142 of image object set information 

(IOBSI) . 

When this still image IMG_02.IOB is played back 



simultaneously with the beginning of playback of music 
#ct, an image of "bruin" shown in (d) of FIG. 10 is 
displayed as an image that represents the first music 
#a in the original PGC (or a jacket image) (on, e.g., 
image display 3710 in FIG. 23 to be described later) 
simultaneously with the beginning of playback of music 
#a. 

Note that audio information (audio data) of music 
#ot corresponds to ATS_01.AOB designated via AOBI#l. 

Music #p in ORG PGC recording region 150 has CI#2 
including TXI#2 and IPI#2, CI#3 including TXI#3 and 
IPI#3, and CI#4 including TXI#4 and IPI#4. 

IPI#2 in CI#2 that designates audio information 
ATS_02.AOB (via AOBI#2) to be played back first in this 
music #P has three image pointers <1>, <2>, and <3>. 
Of these pointers, first pointer IPI#2 <1> designates 
management information of still image IMG_04.IOB 
included in IOBSI recording region 142. 

When this still image IMG_04.IOB is played back 
simultaneously with the beginning of playback of music 
#P, an image of "running businessman" shown in (d) of 
FIG. 10 is displayed as an image that represents the 
second music #P in the original PGC (or a jacket image) 
simultaneously with the beginning of playback of music 
#p. 

Note that second pointer IPI#2 <2> in music #P 
designates still image IMG_02.IOB ("bruin"), which is 



displayed as the second image of music #P, as, e.g., a 
second jacket image. Also, third pointer IPI#2 <3> of 
music #0 designates still image IMG_03.IOB, which is 
displayed as the third image of music #|3, as, e.g., a 
third jacket image (not shown). 

"Bruin" of IMG_02.IOB in (d) of FIG. 10 is a 
representative image for music #a of the original PGC 
but is not a representative image for music #(J of the 
original PGC . However, this "bruin" can be jacket 
images of both music #ot and music #|3. 

Music #y of 0RG_PGC recording region 150 has CI#5 
including TXI#5 and IPI#5, and CI #6 including TXI#6 and 
IPI#6. 

IPI#5 in CI #5 that designates audio information to 
be played back first in this music #y has two image 
pointers <1> and <2>. Of these pointers, first pointer 
IPI#5 <1> designates management information of still 
image IMG_01.IOB included in IOBSI recording region 
142. 

When still image IMG_01.IOB is played back 
simultaneously with the beginning of playback of music 
#y, an image of "personal computer" shown in (d) of 
FIG. 10 is displayed as an image that represents the 
third music #y in the original PGC (or a jacket image) 
simultaneously with the beginning of playback of music 
#Y. 

Note that second pointer IPI#5 <2> of music #y 
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designates still image IMG_04.IOB ("running 
businessman") which is displayed as the second image of 
music #y. 

"Running businessman" of IMG_04.IOB in (d) of 
5 FIG. 10 is a representative image for music #P of the 

original PGC (original play list), but is not a 
representative image for music #y of the original PGC. 
However , this "running businessman" can be jacket 
p images for both music #y and music #P of the original 

tin 

m io pgc. 

kQ On the other hand, in 

m ■ 

gg UD_PGC (user-defined play list) #A in which the user 

J~ re-arranges music numbers (tunes) to have #P as the 

first music number (first tune) and #y as the second 
[7 15 one, IPI#11 of the first music #p designates management 

2 information of still image IMG_03.IOB, and IPI#12 of 

s i 

the second music #y designates management information 
of still image IMG_01.IOB (image of "personal 
computer" ) . 

20 Although not shown in (d) of FIG. 10, the contents 

of text information designated by corresponding text 
information TXI# (or its text pointer information TPI#) 
can be superimposed as needed on the representative 
image (or jacket image) to be displayed. 

25 As alternative names of terms used in this 

specification, for example, the original PGC may be 
called a default play list (original play list), the 
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user-defined PGC may be called a play list, a cell may 
be called a default play list track search pointer/play 
list track search pointer , audio object information may 
be called track information , and image pointer 
5 information IPI may be called an image object search 

pointer. 

In the data structure shown in FIG. 10 , the user- 
defined PGC can only designate a playback sequence as a 

0 sequence of "music number units" or "tune units" 
Em 10 prescribed in the original PGC. 

y3 Each of CI#11 and CI#12 set in the user-defined 

E§ PGC designates only audio information to be played back 

1 = * 

s first in "music number" or in "tune" defined in the 

2 original PGC. 

15 In order to change setups to play back in the 

^ order of "music #y —> music #P" in user-defined PGC#A 

recording region 151 , CI#11 can designate AOBI#5 as 
management information of ATS_05.AOB to be played back 
first in music #y, and the next CI#12 can designate 
20 AOBI#2 as management information of ATS_02.AOB to be 

played back first in music #p. 

In the embodiment shown in FIG. 10 , since only one 
still image IMG_02.IOB is displayed upon playing back 
music #<x, IPI#1 in AOBI#l that describes management 
25 information of audio information corresponding to music 

#a designates only IMG_02.IOB. 

Since this still image alone is designated in 
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music #a, still image IMG_02.IOB is automatically set 
as a representative image (or jacket image) for music 
#cu 

In the embodiment shown in FIG. 10 , a still image, 
to be displayed first for each music number (each tune) 
is automatically set as a representative image (or 
jacket image) for that music number. 

For example, when still images are displayed in 
the order of IMG_04.IOB, IMG_02.IOB, and IMG_03.IOB 
during playback of music #p, IMG_04.IOB to be played 
back first upon playback of music #P is set as a 
representative image (which can also be used as a 
jacket image) indicating the contents of music #p. 
Also, still images IMG_04.IOB, IMG_02.IOB, and 
IMG_03.IOB can be used as jacket images. 

In the embodiment shown in FIG. 10 , music #p is 
made up of three audio information files ATS_02.AOB, 
ATS_03.AOB, and ATS_04.AOB. 

Still image information and text information 
associated with this music #P are recorded in 
management information A0BI#2 that pertains to audio 
information file ATS_02.AOB to be played back first in 
this music #p. That is, text information such as a 
song name, singer name, and the like of music #P is 
recorded in text information #2. 

Also, still image information associated with 
music #P is recorded in the display order of 
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IMG_04.IOB, IMG02.IOB, and IMG_03.IOB in IPI#2. 

Since still images are displayed in the order of 
IMG_01.IOB and IMG_04.IOB during playback of music #y, 
information that designates these still images is 
5 recorded in IPI#5 in management information A0BI#5 of 

audio information which is played back first in music 

#Y- 

The embodiment shown in FIG. 10 does not have any 
special information for setting representative images 

10 in units of music numbers (in units of tunes), and a 

still image which is displayed first in a given music 
number (given tune) is automatically handled as a 
representative image . 

In the embodiment shown in FIG. 10, a display mode 

15 (see display order setting mode information 51 and 

display timing setting mode information 52 in FIG. 20) 
can be set for each management information (AOBI) # of 
an audio object. However, only the display mode set by 
the display mode information (51, 52) in the first AOBI 

20 in a given music number (given tune) is valid. 

When a play list (original play list or user- 
defined play list) is selected, or when specific audio 
information (AOB/TK) is selected, image objects 
(IMG_xx.IOB) corresponding to the selected play list or 

25 audio information can be displayed as jacket images. 

For example, when the user-defined play list shown 
in (a) of FIG. 10 is selected, IMG_01.IOB (personal 
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computer) and IMG_04.IOB (running businessman) can be 
displayed as jacket images on the basis of image 
pointer information IPI#5 of A0BI#5 of music #J3. 

On the other hand f when music #a of the original 
5 play list is selected, IMG_02.IOB (bruin) can be 

displayed as a jacket image on the basis of image 
pointer information IPI#1 of A0BI#1 of music #a. 

FIG. 11 shows views for explaining an example of 
Q the way in which jacket images of respective PGCs are 

5.= S 

yi 10 displayed when audio information with still images 

J3 recorded on the medium according to an embodiment of 

m the present invention is played back in units of 

~~ program chains (PGCs) or in units of play lists. 

O 

.pi In the embodiment shown in FIG. 11 , not only 

J - 

[7 15 representative images (or jacket images) in units of 

jrf music numbers (in units of tunes) but also those in 

units of playback sequences (PGCs) can be set. 

As shown in FIG. 11 , both original and user- 
defined PGCs have pieces of PGC general information 
20 1600, 1660, and 1570 that record general information 

which pertains to each PGC, and pieces of text 
information TXI#Z 430, TXI#A 431, and TXI#B 432, and 
IPI 190, IPI 204, and IPI 205 are recorded in each PGC 
general information . 
25 When playback is made in units of playback 

sequences (PGCs), a still image displayed first is 
automatically set as a representative image (or jacket 
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image) of each playback sequence (PGC). 

when the user selects a playback sequence (PGC) to 
be played back, the contents of PGCSI recording region 
140 in (e) of FIG. 5 or 6 are played back to play back 
5 a still image file indicating a representative image of 

each PGC, and text information TXI#Z 430, TXI#A 431 or 
TXI#B 152 shown in (a) of FIG. 11 is superimposed on 
the played-back image and is displayed on the screen, 
Q as shown in (d) of FIG. 11. 

m 10 In the embodiment shown in FIG. 11, still image 

kfj file information to be displayed for each music number 

(each tune) is described in IPI#2 in the AOBI (AOBI#2 

hi 

in (b) of FIG. 10) to be played back first in a music 
~S number (e.g., #(3 in FIG. 10) (it is described in IPI#2 

[7 15 in CI #2 in the embodiment shown in FIG. 12). 

;!f In the example shown in FIG. 11 as well, by 

selecting a play list (original or user-defined one) 
or audio information (AOB/TK), corresponding image 
information (IMG_xx.IOB) can be displayed as a jacket 
2 0 image . 

FIG. 12 shows views for explaining another example 
of the way in which jacket images of respective music 
numbers (tunes) are displayed when audio information 
with still images recorded on the medium according to 
25 an embodiment of the present invention is played back 

in units of music numbers (tunes) or in units of play 
lists . 



A method of setting a jacket image will be 
explained first. 

In a method of setting jacket images using pieces 
of image pointer information IPI#1 to IPI#12 (a method 
of setting a still image to be displayed first in each 
music number (each tune) as a jacket image , or a method 
of setting a still image set by representative 
image/ jacket image designation flag 71 in units of 
music numbers (tunes) or PGCs, as shown in (d) of 
FIG. 20 to be described later) , a still image file 
number is directly designated. 

By contrast, in an application example to be 
described below, the numbers of pieces of management 
information 1 to 4 corresponding to still image 
information files in IOBSI recording region 142 are 
designated, as shown in (b) of FIG. 12. 

That is, in the data structure shown in FIG. 10, 
still image information displayed upon playing back a 
music number (tune) designated in user-defined PGC 
(UD_PGC#A) recording region 151 matches that to be 
displayed upon playing back a music number (tune) 
designated by original PGC (ORG_PGC) information 
recording region 150. 

By contrast, in the data structure shown in 
FIG. 12, IPI#11 and IPI#12 in pieces of cell 
information CI#11 and CI#12 defined in UD_PGC#A 
recording region 151 can designate arbitrary still 
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images, which are not restricted by those to be 
displayed in units of music numbers (tunes) designated 
in ORG__PGC information recording region 150. 

That is, "pieces of management information 1 to 4 
5 corresponding to IMG_xx.IOB" in (b) of FIG. 12 serve as 

conversion files for pointer information (IPI#) that 
designates a still image ( IMG_xx. IOB) . 

In the embodiment shown in FIG. 12, number 
information of each of pieces of management information 
10 1 to 9 that pertain to respective IMG_xx.IOB in (b) of 

FIG. 19 is recorded in place of "still image file 
number 72 of the M-th still image to be displayed in a 
music number (tune), PGC, or play list" in (d) of 
FIG. 20. 

15 In the embodiment shown in FIG. 10, still image 

information files ("personal computer" of IMG_01.IOB 
and "running businessman" of IMG_04.IOB) to be 
displayed upon playing back music #0 and music #y 
defined in user-defined PGC#A match those ("personal 

20 computer" of IMG_01.IOB and "running businessman" of 

IMG_04.IOB) to be displayed upon playing back music #y 
and music #p defined in the original PGC, and cannot be 
arbitrarily changed. 

By contrast, in the embodiment shown in FIG. 12, 

25 since each cell information CI# has individual image 

pointer information IPI#, still image files to be 
displayed can be set for each CI . 
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In the example shown in FIG. 12 as well, by 
selecting a play list (original or user-defined one) or 
audio information (AOB/TK) , corresponding image 
information (IMG_xx.IOB) can be displayed as a jacket 
5 image . 

FIG. 13 shows views for explaining an example of 
the playback relationship (arrows in FIG. 13) between a 
plurality of music numbers (tunes) stored in the 
Q information storage medium of FIG. 5 or FIG. 6, and 

CP 10 text ( characters , symbols, figures, and/or marks) 

5 S3 

e : 5 

yj appended to these music numbers. 

p In (a) to (d) of FIG. 13, audio object 

T* information AOBI# and image pointer information IPI# in 

e 

^ (c) of FIG. 8 are replaced by text object informatxon 

f7 15 TOBI# and text pointer information TPI#, and there is 

Jj? shown an example of the way in which text information 

to be simultaneously displayed during playback of a 
music number is managed. 

FIG. 14 shows views for explaining another example 
20 of the playback relationship (arrows in FIG. 14) 

between a plurality of music numbers (tunes) stored in 
the information storage medium of FIG. 5 or FIG. 6, and 
text (characters, symbols, figures, and/or marks) 
appended to these music numbers. 
25 In (a) to (d) of FIG. 14, image object information 

IOBI# in (c) of FIG. 9 is replaced by text object 
information TOBI#, and there is shown another example 
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of the way in which text information to be 
simultaneously displayed during playback of a music 
number is managed. 

FIG. 15 shows views for explaining still another 
example of the playback relationship (arrows in FIG. 
15) between a plurality of music numbers (tunes) stored 
in the information storage medium of FIG. 5 or FIG. 6, 
and text (characters, symbols , figures , and/or marks) 
appended to these music numbers. 

In FIG. 15 , image pointer information IPI# in 
FIG. 8 is replaced by text pointer information TPI#, 
and there is shown still another example of the way in 
which text information to be simultaneously displayed 
during playback of a music number is managed. 

FIG. 16 shows views for explaining the data 
structure of an image object set information 
(IOBSI.IFO) file recorded on the information storage 
medium according to an embodiment of the present 
invention. 

FIG. 17 shows views for explaining the data 
structure of management information (26*) of still 
image ID information in the image object set 
information (IOBSI.IFO) file shown in FIG. 16. 

In the embodiment of the present invention, ID 
information (xx of IMG_xx.IOB; xx - 01 to 52 in the 
example shown in FIG. 17) is appended to each still 
image information (IMG_01.IOB to IMG__52 . IOB) , as shown 



in (d) of FIG. 17 , and management information 26* (2- 
bit flag) indicating if given ID information 
(IMG_xx.IOB) is used ("01") or unused ("00") is 
provided , as shown in (e) of FIG. 16 and (b), (c) of 
FIG. 17. 

Since this flag consists of 2 bits / four different 
states can be discriminated. For example, if flag = 
00b, it indicates "unrecorded" (absence of still image 
data); if flag = 01b, it indicates "recorded No. 1" 
(presence of still image data); if flag = 10b, it 
indicates " recorded No. 2" (presence of image data 
with text such as words or the like); and if flag = 
lib, it indicates "recorded No. 3" (presence of motion 
JPEG data obtained by, e.g., continuous shots (a 
maximum of 20 images per music number or per tune) or 
the like of a digital camera), thus allowing four 
different ways of flag identification. 

In the embodiment of the present invention, each 
still image information (IOB) is recorded as an 
independent file. As a file extension of such still 
image information (IOB), "IOB" is used. 

In the embodiment of the present invention, an 
independent file name (xx of IMG_xx.IOB) is set for 
each still image information (IOB) as ID information 
used to identify each still image information (IOB). 
To allow easy ID information management, a number such 
as " IMG_xx" or the like is assigned as an independent 
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file name, and a number (xx) assigned to this file name 
is managed as ID Information used to identify each 
still image information (IOB). 

Management information as to whether or not unique 
5 ID information is assigned is recorded as "management 

information 26* of still image ID information" in IOB 
bitmap information 12 as configuration information of 
IOBSI management information 10 in IOBSI.IFO file 213 0 , 
O as shown in FIG. 16. 

£H 10 IOBSI.IFO file 2130 that contains management 

y3 information as to whether or not unique ID Information 

£0 is assigned is allocated under real-time audio 

b~ recording directory 2100 , as shown in FIG. 7, and is 

J physically recorded in IOBSI recording region 142 in 

[7 15 (e) of FIG. 5. 

^ In the embodiment of the present invention , a 

maximum of 999 still image files as still image 
information (IOB) can be recorded in the information 
storage medium such as audio card 100 with the copy 

20 protection function shown in (a) of FIG. 5. 

A major characteristic feature of the embodiment 
of the present invention lies in that fields for 
recording still image information (IOB) for a maximum 
of 999 images are set in advance, and the information 

25 description field size (data size) for each still image 

information (IOB) is a fixed length, as shown in (b) or 
(e) of FIG. 16. 
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With this data structure, the start address of 
each information in IOBSI.IFO file 2130 (for example , 
the start address of management information 2 that 
pertains to IMG_02.IOB, and the address of 
recorded/unrecorded flag 45 for IMG_05.IOB) remains 
unchanged even by new recording/ a change in information 
contents /deletion of each still image information 
(IOB) . 

As a result, since the start address of each 
information is predetermined even by repeating new 
recording/a change in information contents /deletion of 
each still image information (IOB), system controller 
3020 of the information recording/playback apparatus 
shown in FIG. 23 need only read only required 
information in IOBSI.IFO file 2130. That is, since a 
buffer memory (not shown) of system controller 302 0 
need only temporarily save minimum required 
information, the buffer memory size can be saved. 

For this reason, the buffer memory size in system 
controller 3020 can be small, and the information 
recording/playback apparatus shown in FIG. 2 3 can be 
manufactured with relatively low cost. 

Also, according to the embodiment of the present 
invention, since the start address of each information 
is predetermined, system controller 3 02 0 in the 
information recording/playback apparatus in FIG. 2 3 can 
directly access the required position (address) in 
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IOBSI.IFO file 2130. Hence, simple, high-speed access 
can be attained. 

Recorded/unrecorded flags 41* to 49* for 
IMGxx.IOB are set to have 2 bits each. 
5 A "01" flag is set for "ID number IMG_xx" assigned 

to a still image file recorded in IOB recording region 
132 in the information storage medium shown in (d) of 
FIG. 5, and a "00" flag is set for "ID number IMG_xx" 
which is not assigned to a recorded still image file 
10 yet. 

A practical setting method of the flags will be 
explained below using FIG. 17. 

When still image files IMG_01.IOB, IMG_03.IOB, 

IMG_05.IOB, IMG_07.IOB, IMG_08.IOB, , IMG_51.IOB, and 

15 lMG_52.IOB are recorded in the information storage 

medium, as shown in (d) of FIG. 17, the contents of 
recorded/unrecorded flags 41* to 49* corresponding to 
these IMG_xx.lOB are as shown in (c) of FIG. 17. 

In (d) of FIG. 17, since still image files 
20 IMG_02.IOB and IMG_04.IOB are unrecorded, flags 42* and 

44* corresponding to these files assume a value "00", 
as shown in (c) of FIG. 17. 

Also, in (d) of FIG. 17, since still image files 
are recorded up to IMG_52.IOB, the contents of "final 
25 number information 22 of recorded still image (IOB) 

files" in (a) of FIG. 17 are "52". 

A sequence for recording new still image 



information (IOB) in the information storage medium 
using the apparatus shown in FIG. 23 is as follows. 

<01> The number of pieces of still image 
information to be recorded and attribute information 
(see (c) and (d) of FIG. 19) such as a resolution, 
compression method, and the like are input at data 
input PC 3640 in FIG. 23 via inter-PC data I/F 
processor 3540. 

<02> System controller 3020 issues an instruction 
to information recorder /player 3000 to play back 
IOBSI.IFO file 2130 (FIG. 7) recorded in IOBSI 
recording region 142 in (e) of FIG. 5 and to 
temporarily save it in its internal buffer memory 
(not shown) . 

<03> System controller 3020 plays back final 
number information 22 of still image (IOB) files 
recorded in IOBSI.IFO file 2130 temporarily saved in 
the buffer memory. 

<04> System controller 3020 plays back 
information of "recorded/unrecorded flags 41* to 4 9*" 
for IMG_xx.IOB in (b) of FIG. 17 recorded in IOBSI.IFO 
file 2130 temporarily saved in the buffer memory from 
the first number to the number ("52" in the example in 
(d) of FIG. 17) set by "final number information 22" 
read in <03> above. System controller 3020 then 
searches for unrecorded ID numbers with flags = "00" in 
(c) of FIG. 17 from the read number range (from IMG_01 



to IMG_52) . 

In the embodiment of the present invention, since 
the start address of each information is predetermined, 
the unrecorded ID number search process need only play 
back required information. 

<05> System controller 3020 records each still 
image information (IOB) input via inter-PC data I/F 
processor 3540 in the information storage medium 
(memory card 100) while setting the number of a still 
image file name in accordance with the ID number 
(IMG_xx with flag "00") extracted in <04> above. 

At this time, the operation of information 
recorder /player 3000 is controlled by system controller 
3020. 

<06> Upon completion of recording of still image 
information (IOB), system controller 3020 changes the 
contents of IOBSI management information 10 ((b) of 
FIG. 16) in IOBSI. IFO file 2130 temporarily saved in 
the buffer memory. 

<07> System controller 3020 records information 
such as a resolution, compression method, and the like 
of still image information input in <01> above in still 
image attribute information 431 ((c) of FIG. 19) 
temporarily saved in the buffer memory. 

In the embodiment of the present invention, since 
the start address of each information is predetermined, 
pieces of management information 1 to 9 associated with 
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IMG_xx.IOB to be recorded can be directly accessed and 
recorded. For this reason , a recording process is very 
easy, and can be executed at high speed. 

<08> When the number item of music number (or a 
tune number) for displaying each still image 
information recorded in the information storage medium 
is designated at data input PC 3640 , system controller 
3020 issues an instruction to information 
recorder/player 3000 to read out information of image 
pointer information IPI# (IPI#1 to IPI#5 and the like 
in (c) of FIG. 8) in A0BI# corresponding to the 
designated music number , change the contents of readout 
IPI#, and then record IPI# on the information storage 
medium again. 

<09> At this time, when a new representative 
image is set, system controller 3020 changes 
information of "bitmap information 27 of a still image 
(IOB) file designated as a representative image" ((d) 
of FIG. 16) in IOBSI.IFO file 2130 temporarily saved in 
the buffer memory. 

<10> Upon completion of changes in data of 
IOBSI.IFO file 2130 temporarily saved in the buffer 
memory of system controller 3020, system controller 
3020 issues an instruction to information 
recorder/player 3000 to write back IOBSI.IFO file 2130 
in the buffer memory to the information storage medium. 

A method of generating a list of still image files 
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recorded on the information storage medium in the 
embodiment of the present invention will be explained 
below. 

For example, when a music number (tune) to which 
5 still image information recorded on the information 

storage medium is attached is set using a PC, 
information of this "still image file list" is 
required. 

□ In the conventional method, after all IMG_xx.IOB 

yf 10 files shown in FIG. 16 are collected using file system 

d3 drive software such as FAT, UDF, or the like, their 

Ul 

tg file names are read, and the relationship between these 

*" file names and IOBSI.IFO file 2130 must be checked, 

: n resulting in complicated, much time-consuming list 

£~ 15 generation. 

jrf By contrast, in the embodiment of the present 

invention, since only a simple process to be described 
below is required, the still image file list can be 
generated at high speed. 

20 <21> The user issues a generation instruction of 

the still image file list recorded on the information 
storage medium. 

<22> System controller 3020 issues an instruction 
to information recorder/player 3000 to play back 

25 IOBSI.IFO file 2130 (FIG. 16, FIG. 7) recorded in IOBSI 

recording region 142 in (e) of FIG. 5 and temporarily 
save played back information in its internal buffer 



memory ( not shown ) . 

<23> System controller 3020 reads "management 
information 26* of still image ID information" ((d) of 
FIG • 16) in the buffer memory, and displays a list of 
already recorded still image file numbers on image 
display 3710 in FIG. 23. 

Since the already recorded still image file 
numbers are known, it is easy to display each still 
image . 

When attributes of each still image must be 
displayed at the same time, 

<24> system controller 3020 directly accesses 
required "attribute information 431 of a still image" 
((c) of FIG. 19) in the buffer memory, and displays it 
simultaneously. 

In the embodiment of the present invention, since 
the start address of each information is predetermined, 
pieces of management information 1 to 9 associated with 
IMG_xx.IOB to be recorded can be directly accessed and 
recorded. For this reason, a recording process is very 
easy, and can be executed at high speed. 

FIG. 18 shows views for explaining the data 
structure of bitmap information (27) of a still image 
file designated as a representative image or jacket 
image in image object set information (IOBSI.IFO) in 
FIG. 16. 

FIG. 19 shows views for explaining the data 
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structure of management information that pertains to 
each image object (lMG_xx.IOB) in the image object set 
information (IOBSI.IFO) in FIG. 16. 

The data structure in IOBSI.IFO file 2130 will be 
5 explained below with reference to FIGS. 18 and 19. 

As shown in (b) of FIG. 18 or 19, IOBSI.IFO file 
2130 is made up of IOBSI management information 10 that 
records general information which pertains to all 

0 pieces of still image information , and pieces of 
yi 10 management information 1 to 9 that pertain to 

Jo IMG_01.IOB to IMG_999.IOB. 

1 rl 

*sr 5 

jg Note that the data size of IOBSI management 

~~ information 10 and that of each of pieces of management 

information 1 to 9 that pertain to IMG__01.IOB to 
[7 15 IMG_999.IOB are fixed sizes. Since the fixed data size 

JS? is used, an access destination upon recording/playback 

of management information that pertains to each still 

image can be detected in advance. 

For example, when management information that 
20 pertains to IMG_02.IOB is played back, an address 

obtained by adding the data sizes of IOBSI management 

information 10 and management information 1 that 

pertains to IMG_01.IOB r which are predetermined, can be 

accessed. 

25 IOBSI management information 10 has image object 

set general information IOBS — 61-11 that records general 
information of still images, and information 11 records 
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the total number 21 of still image files (that matches 
the number of still images) recorded in IOB recording 
region 132 in the information storage medium (audio 
card 100 with the copy protection function or disc- 
shaped information storage medium 170), and final 
number information 22 of the recorded still image (IOB) 
files. 

Also, IOBSI management information 10 includes 
IOBS bitmap information 12 that records bitmap 
information pertaining to all still images. 

As an example of contents of bitmap information 27 
of a still image (IOB) file designated as a 
representative image (or jacket image), representative 
image designation flags 31 to 3 9 are stored. 

These flags are assigned to IMG_01.IOB file by 2 
bits, IMG_02.IOB file by 2 bits,..., i.e., a 2-bit flag 
is assigned to each file, and a flag other than "00" is 
set in a still image file that stores a still image 
designated as a representative image (or jacket image) 
of the still image files ("00" is set in a still image 
file which stores a still image which is not designated 
as a representative or jacket image). 

Since this flag consists of 2 bits, four different 
states can be discriminated. For example, if flag = 
00b, it indicates "no designation" (normal still 
image); if flag = 01b, it indicates "representative 
image designation"; if flag = 10b, it indicates "jacket 
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image designation " ; and if flag = lib, it indicates 
"other image designation", thus allowing four different 
ways of flag identification. As an example of other 
image designation, simultaneous designation of both the 
5 representative and jacket images can be made. 

Note that IMG_xx.IOB in (e) of FIG. 18 can contain 
text information (in, e.g., a bitmap format) that 
describes the words, profiles of an artist, recording 

p data, and the like of the music number (tune) of 

gl 10 interest, as needed. 

J Each of pieces of management information 1 to 9 

fjg that pertain to respective still image files is made up 

^ of still image attribute information 431 and 

;^ designation state information 432 of a representative 

f7 15 image (or jacket image), as shown in (d) of FIG. 19. 

y Still image attribute information 431 includes 

compression method/compression version information 441 
of a still image, resolution information 422 of a still 
image, and recorded/unrecorded flag 41* for the 
20 corresponding image data. 

Compression method/compression version information 
441 records a compression method such as JPEG, MPEG (I- 
picture), or the like and its version information. 
Resolution information 442 records resolution 
25 information of the corresponding image data. 

Recorded/unrecorded flag 41* records 

recorded/unrecorded flag (2-bit flag indicating the 
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presence/absence of still image data) 41* for 
corresponding image data (IMG_01.IOB in this case). An 
information file that pertains to this 
recorded/unrecorded flag 41* can be recorded together 
5 in subdirectory 2400 in FIG. 7. 

On the other hand, representative image 
designation state information 4 32 records information 
450 of the number of music numbers (the number of 
Q tunes) that designate the still image of interest as a 

01 10 representative image (or jacket image), and N "music 

=fl number /tune number, AOBI number, or CI number that 

y § 

fg designates the still image of interest as the first 

~~ representative image (or jacket image)" 451,..., 452 (N 

ipsa. 

is a positive fixed value). 

15 Note that the upper limit value of the number item 

~ of music numbers (number of tunes) or the number of 

audio information files that can set for given still 
image information as a representative image (or jacket 
image) is N. N is equal to or smaller than a maximum 

20 of 999, and is preferably 10 or less in practice (to 

reduce the load of management). 

As shown in (d) of FIG. 19, representative image 
designation state information 432 has description 
fields up to music number/tune number or AOBI number/CI 

2 5 number 452 that designates the still image of interest 

as the N-th representative image (or jacket image). 
Numbers are filled in turn from music number/tune 
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number or AOBI number /CI number 451 that designates the 
still image of interest as the first representative 
image (or jacket image) in accordance with information 
450 indicating the number item of music numbers (number 
5 of tunes) that designate the still image of interest as 

a representative image (or jacket image), and the 
remaining fields are set at "0". 

Note that the data structure in the IOBSI.IFO file 
2130 shown in FIG. 18 or FIG. 19 can be applied not 

10 only to that shown in FIG. 10 or FIG. 11, but also to 

the data structure shown in FIG. 12. 

FIG. 2 0 shows views for explaining the data 
structure of image pointer information ( IPI ) shown in 
FIGS. 1 to 4, and FIGS. 10 to 12, and the like. 

15 Image pointer information 40 (corresponding to IPI 

in FIGS. 1 to 4 and FIGS. 8 to 12) in (a) of FIG. 20 
records still image display mode information 43 (51, 
52) and still image designation information 47 in units 
of music numbers (tunes), in units of PGCs, or in units 

20 of play lists. 

As shown in (c) of FIG. 20, display mode 
information 43 includes mode information 51 for setting 
the display order of still images, and mode information 
52 for setting the display timings of still images. 

25 The still image display order setting mode 

information 51 has contents for designating a 
"sequential mode" for displaying images in turn in 



- 74 - 



accordance with the designated playback order, a 
" random/ shuf f le mode" for randomly displaying 
designated still images, a "browse mode" for switching 
a still image to be displayed at the input timing of 
5 the user (to allow the user to review a plurality of 

still images ) . 

Still image display timing setting mode 
information 52 has contents for setting the display 
Q timings of one or more still images set in a music 

01 10 number (tune) in synchronism with divisions of audio 

y ! 

fcp frames of an AOB managed by, e.g., AOBI (TKI). 

jg In this embodiment, a maximum of M still images 

hi 

~~ can be displayed in units of music numbers (tunes) or 

a 

« in units of PGCs. M is a fixed value, which is 

rr 15 selected from a range from 5 to 100 images, and is 

y preferably around 20. 

The data size of image pointer information (IPI) 
40 is always fixed, and fields are initially set from 
the description field of still image 61 to be displayed 
20 first to that of information 69 of a still image to be 

displayed as the M-th image, as shown in (c) of FIG. 
20. 

In the description field of still image 61 to that 
of information 69 to be displayed as the M-th image, 
25 file numbers (e.g., "02" in case of IMG_02.IOB) 72 of 

still image files designated by IPI 40 are recorded in 
the display order. 
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When the number of designated still image files is 
small, "0" is recorded in the remaining fields. For 
example, in case of IPI 40 that does not designate any 
still image files at all, "0" is recorded from the 
5 description field of still image 61 to be displayed 

first to that of information 69 of a still image to be 
displayed as the M-th image. 

Information indicating the number of still images 
□ designated for each IPI 4 0 is recorded in the number 60 

m 10 of still images to be displayed in units of music 

i n 

j=j numbers (tunes), PGCs, or play lists shown in (c) of 

FIG. 20. 

2~ By playing back this information, description 

l % fields from the description field of still image 61 to 

!"* 15 be displayed first to that of information 69 of a still 

Jff image to be displayed as the M-th image, which record 

was? 

"designated still image file number information" can be 
detected. 

In this embodiment, a still image stored in a 
2 0 still image file corresponding to still image file 

number 72 designated in "information 61 of a still 
image to be displayed first" shown in (c) of FIG. 20 
serves as a representative image (or jacket image). 

However, the present invention is not limited to 
2 5 this. For example, the first 1 or 2 bits of pieces of 

information 61 to 69 of still images to be displayed in 
turn are assigned to designation flag 71 of a 
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representative image (or jacket image) in units of 
music numbers (tunes), PGCs, or play lists, as shown in 
(d) of FIG. 20. Then, a still image stored in a still 
image file number with this 1- or 2-bit flag = "1" or 
5 "01" can be set as a representative image (or jacket 

image ) . 

With this method, a still image other than a 
"still image to be displayed first" in units of music 
p numbers (tunes), PGCs, or play lists can be set as a 

m 10 representative image (or jacket image), 

ijjg FIG. 21 is a view for explaining the playback 

gi" relationship (broken arrows in FIG. 21) between a 

plurality of music numbers (tunes) and still images 

Q 

~z (that can include jacket images, word card images, and 

f7 15 the like) appended to these music numbers when cell 

2 information (CI#) in FIG. 10, etc. is changed to read a 

track search pointer (DPL_TK_SRP# ) , audio object 
information (AOBI#) in FIG. 10, etc. is changed to read 
track information (TKI#), and image pointer information 
20 (IPI#) in FIG. 10, etc. is changed to read a track 

information search pointer (TKI_IOB_SRP) for an image 
object. 

By changing certain terms as follows (changes of 
terms), the playback relationship mentioned above with 
25 reference to FIGS. 8 to 10, etc. can be applied to FIG. 

21: 

* PGC set information — > play list manager PLM; 



* original PGC — > default play list DPL; 

* individual user-defined PGC — > individual play 
list PL; 

* cell information CI — > track search pointer 
DPL_TK_SRP of default play list; 

* audio object information AOBI — > track 
information TKI; 

* cell information CI -» track information TKI; 

* image pointer information IPI — » track 
information image object search pointer TKI_IOB_SRP; 
and 

* time map information TMI — > time search table 
TMSRT . 

In the structure shown in FIG* 21 , when music #p 
is a long one, an AOB file of music #P may be 
automatically segmented in units of specific times, and 
track information TKI (corresponding to AOBI or CI) may 
be appended to the segmented AOB files. 

In this case, AOB file numbers after segmentation 
are assigned in correspondence with the numbers of 
assigned TKIs. 

Only the first TKI of each music number (each 
tune) is designated by each user-defined play list PL 
in place of default play list DPL. In this case, still 
images displayed in units of music numbers (tunes) are 
designated by the first TKI of each music number. 

In the example shown in FIG. 21, an unrecorded 
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region or unused region is assured in correspondence 
with the contents of default play list DPL or track 
manager TKM (management information). 

Since an unrecorded region (unused region) can be 
5 set in management information in this manner, even when 

a portion of the management information is deleted by, 
e.g., editing, other portions of the management 
information need not be modified, thus allowing simple 

p handling of the management information. 

m 10 Furthermore, the size of each TKM (management 

information) including an unused region is fixed (e.g., 

m at 1,536 bytes), management of the recording location 

w (address) of each TKM (management information) can also 

~ be simplified. 

15 In this way, the buffer memory size of the 

O playback apparatus required for the management 

information (the size of the internal buffer (not 
shown) of, e.g., information recorder /player 3000 in 
the apparatus shown in FIG. 23) can be greatly reduced. 
20 In the aforementioned structure, display mode 

information 43 (51, 52) in FIG. 20 is provided to each 
music number (each tune). If a music number includes a 
plurality of pieces of TKI (AOBI), only the display 
mode information included in image pointer information 
25 (IPI 40 in FIG. 20) of the first TKI (AOBI) of that 

music number is handled as a valid one that can 
designate the display order (display sequence) and/or 



display timings of still images of that music number. 

FIG. 22 shows views for explaining an example of 
the format (data structure) when encrypted audio 
information is recorded on the audio card with the copy 
protection function shown in FIG. 5. 

The data structure in audio object file 2500 ((a) 
of FIG. 22) in the embodiment of the present invention 
will be explained below. 

Audio information (audio object AOB) is made up 
of audio object units AOBU 2510 to AOBU 2530 ((b) of 
FIG. 22). 

Each of these AOBU 2 510 to AOBU 2530 is formed by: 

(01) segmenting information into units each 
having a specific data size (32-kbyte unit, 16-kbyte 
unit, 512-kbyte unit, or the like); 

(02) segmenting information into units at 
specific audio frame counts; or 

(03) segmenting information into units at 
playback time units (0.2-sec unit, 1-sec unit, 2-sec 
unit, 5-sec unit, 10-sec unit, or the like). 

In the embodiment of the present invention, 
compression of audio information uses AAC (advanced 
audio coding) of MPEG. 

As shown in (c) of FIG. 22, audio object file 2500 
is formed of a set of a plurality of audio frames 2 610 
to 2630. 

Since the number of audio frames included in each 
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audio object file 2500 is described in audio object 
information AOBI in (c) of FIG. 8, the "total number of 
frames of each music number (each tune)" can be 
obtained using relationship information with music 
5 numbers (tunes) described in cell information CI. 

The information of the "total number of frames of 
each music number (each tune)" is recorded in audio 
object information (e.g., AOBI#2 in music #P) 
q corresponding to an audio information file to be played 

m 10 back first in the music number. 

i~~ - 

In AAC, each of audio frames (AOB frames) 2610 to 
y 2630 ((c) of FIG. 22) is formed of ADTS (advanced audio 

^ coding transport stream, or audio data transport 

*f stream) header 2 710, and audio information recording 

p 15 region 2740 ((d) of FIG. 22). 

□ ADTS header 2710 includes fixed header 2720 

including a sync word of an AOB, and variable header 
2730 ( (d) of FIG. 22) . 

In an encryption method of audio information 

20 (AOB), as shown in (e) of FIG. 22, ADTS header 2710 is 

set as non-encrypted region 2810 (a plane state without 
encryption), and compressed audio information recording 
region 2740 is encrypted every encryption unit (#a to 
#f ) in turn from its head position. 

25 For example, data in each encryption unit (#a to 

#f ) undergoes an arithmetic process in accordance with 
a cipher key (encryption key) generated based on a 



random number , and that arithmetic operation result is 
recorded as encrypted information. 

Encryption is done within each encryption unit (#a 
to #f), and the arithmetic process based on the cipher 
key (encryption key) repeats itself every encryption 
unit (#a to #f ) . 

In the embodiment of the present invention, each 
encryption unit ( #a to #f) has a 64- or 56-bit unit. 
The size of compressed audio information recording 
region 2740 does not always match an integer multiple 
of 64 bits. Hence, only region M g" as the remainder 
(fraction part) obtained by dividing compressed audio 
information recording region 2740 by an integer 
multiple of the encryption unit is held in a non- 
encrypted, plane state. 

That is, non-encrypted region "g" is assured as a 
kind of padding region to match the size of compressed 
audio information recording region 2740 with an integer 
multiple of 64 bits. 

FIG. 23 is a block diagram for explaining an 
example of the arrangement for recording information or 
playing back information on or from the audio card with 
the copy protection function shown in FIG. 5. 

FIG. 24 is a flow chart for explaining the 
sequence of a mutual authentication process and cipher 
key (encryption key) exchange process done between the 
audio card in FIG. 5 (or optical disc shown in FIG. 6), 
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and the recording/playback apparatus shown in FIG, 23. 

The arrangement of a recording system capable of 
writing information (audio information and/or still 
image information) to be copy-protected in audio card 
(memory card) 100 will be explained first. 

As a popular device that digitally records still 
image information which can be handled by the apparatus 
in FIG. 23 , a digital camera is known. Still image 
information to be digitally recorded is also used as a 
menu image in DVD video that digitally records /plays 
back moving picture information (I-picture of MPEG can 
be considered as still image information) in addition 
to the digital camera. 

As means for inputting such still image 
information to the apparatus shown in FIG. 23, 

(11) video capture unit 3510 captures a video 
signal from CCD camera 3610 or TV tuner 3620 to convert 
it into a still image, and an A/D converter (not shown) 
built in video capture unit 3510 converts the captured 
still image into a digital signal and inputs the 
digital signal to input data transfer destination 
switching unit (data bus line) 3210; 

(12) still image information sensed by digital 
camera 3630 is sent to I/F processor 3520 of the 
digital camera using a serial transmission line such as 
RS-232C or the like, and is input to input data 
transfer destination switching unit 3210; 
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(13) still image information created using 
personal computer (PC) 3640 or still image information 
scanned by an image scanner connected to this PC is 
input to input data transfer destination switching unit 
5 3210 via inter-PC data I/F processor 3540; and so 

forth. 

As means for inputting text information to the 
apparatus shown in FIG. 23 , 
rg (14) key input data from a keyboard is input to 

m 10 input data transfer destination switching unit 3210; 

yn (15) character selection/designation is made 

i n 

*q using dial rotation/dial in used in, e.g., a digital 

^ camcorder to input character codes of JIS, ASCII, or 

the like to input data transfer destination switching 
[~ 15 unit 3210; and so forth. 

y Furthermore, as means for inputting audio 

Q 

information to the apparatus shown in FIG. 23, 

(16) an analog audio signal (e.g., an analog 
playback output of a CD player) externally input via 

20 analog input terminal 357 0 is converted into a digital 

signal by DAC 3350, the digital signal undergoes, e.g., 
MPEG2/AAC compression coding by audio encoder 3310, and 
the compressed digital signal is input to input data 
transfer destination switching unit 3210 (whether or 

25 not compression is done by audio encoder 3310, the 

compression method to be used if compression is done, 
and so forth can be determined in accordance with an 



instruction from system controller 3020); 

(17) an analog audio signal input from audio 
input microphone 3650 via microphone input terminal 
3560 is converted into a digital signal by DAC 3350 , 
the digital signal undergoes MPEG2/AAC compression 
coding by audio encoder 3310 , and the compressed 
digital signal is input to input data transfer 
destination switching unit 3210; 

(18) a digital audio signal (e.g., a linear PCM 
digital output from a CD player) externally input via 
digital input terminal 3580 undergoes MPEG2/AAC 
compression coding by audio encoder 3310 , and the 
compressed digital signal is input to input data 
transfer destination switching unit 3210; 

(19) already compressed digital audio information 
is directly fetched by data input PC 3640 from a WWW 
(World Wide Web), the Internet, and the like via a 
modem (not shown). The digital audio information is 
input to input data transfer destination switching unit 
3210 via inter-PC data I/F processor 3540; and so 
forth . 

Desired ones (e.g., JPEG-compressed still image 
information from digital camera 3630 and MPEG- 
compressed audio information from audio encoder 3310) 
of various kinds of digital information input by the 
aforementioned methods are selected under the control 
of system controller 3020. The selected information 
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( JPEG-compressed still image information and MPEG- 
compressed audio information) is transferred to 
information recorder /player 3000 via input data 
transfer destination switching unit (data bus line) 
5 3210. 

Note that audio input information or still image 
information transferred to information recorder/player 
3000 is sometimes appended with information of analog 
p copy generation management system CGMS-A when it is an 

oS 10 analog input signal or information of digital copy 

generation management system CGMS-D when it is a 
digital input signal. 

When "copy freely" information (2-bit flag) is 
described as the information of copy generation 
15 management system CGMS, since no encryption is 

required, non-encrypted , plane input information is 
transferred from input data transfer destination 
switching unit 3210 to information recorder/player 
3000, 

20 On the other hand, when CGMS-A or CGMS-D 

designates copy restriction, copy-restricted 
information is transferred from input data transfer 
destination switching unit 3210 to encryption processor 
3110. 

25 Encryption processor 3110 encrypts the copy- 

restricted information on the basis of a cipher key 
(encryption key) randomly generated by cipher key 
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(encryption key) generation/saving unit 314 0 (see (e) 
of FIG. 22 for the encryption method). 

Audio information and/or still image information 
encrypted by encryption processor 3110 are/is sent to 
mutual authentication/key exchange & encrypted 
information I/F controller 3120. 

Mutual authentication/key exchange & encrypted 
information I/F controller 3120 transfers the encrypted 
audio information and/or still image information to 
information recorder /player 3000. The information to 
be transferred to information recorder/player 3000 is 
appended with copy restriction information (2-bit flag) 
of CGMS-A or CGMS-D as needed. 

When "copy once" information is described as CGMS 
information, the encrypted audio input information is 
transferred from mutual authentication/key exchange & 
encrypted information I/F controller 3120 to 
information recorder /player 300 0 together with this 
CGMS information while being appended with a decryption 
key. 

When "copy never" information is described as CGMS 
information , the encrypted audio input information is 
transferred from mutual authentication/key exchange & 
encrypted information I/F controller 3120 to 
information recorder /player 3000 together with this 
CGMS information without any decryption key. 

Alternatively, when "copy never" information is 



described as CGMS information, only a warning message 
"this program is copyrighted and cannot be recorded" 
may be transferred from mutual authentication/key 
exchange & encrypted information I/F controller 3120 to 
information recorder /player 3000, so as to inhibit 
recording other than this warning. 

The CGMS information (a 2-bit flag indicating the 
type of copy restriction or a warning message of 
copyright protection) can be written in, e.g., card 
unique ID & key information recording region (RAM) 103 
in audio card (memory card) 100 shown in (a) of FIG. 5. 

Alternatively, the CGMS information (a 2-bit flag 
indicating the type of copy restriction or a warning 
message of copyright protection) can be written in a 
rewritable data zone of lead-in area 1800 or management 
information recording region 130 in (d) of FIG. 6 in 
optical disc 170 shown in (a) of FIG. 6. 

The operations of the aforementioned encryption 
related units (3110 to 3140) (selective encryption 
depending on the contents of CGMS information) are 
controlled by system controller 3020. 

More specifically, information recorder/player 
3000 includes: 

(21) a contact electrode section when the 
information storage medium is audio card (memory card) 
100; 

(22) a magnetic head in an HDD and HDD rotation 
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control circuit when the information storage medium is 
a removable hard disk; 

(23) an optical head and disc rotation control 
circuit when the information storage medium is a 
recordable/reproducible optical disc; and the like 
(FIG. 23 exemplifies a case wherein memory card 100 is 
used) . 

A description of the arrangement in FIG. 23 will 
continue assuming that audio information and/or still 
image information, which are/is copy-managed by CGMS, 
are/is recorded/played back on/from audio card (memory 
card) 100. 

At the same time, a mutual authentication & key 
exchange process between audio card (memory card) 100 
and the apparatus in FIG. 23 will be parallel explained 
with reference to FIG. 24. 

When audio card (memory card) 100 is loaded into 
information recorder/player 3000 in FIG. 23 (by the 
user), card 100 is powered from the information 
recorder /player 3000 side via electrodes (not shown) of 
the card. Control CPU/MPU 101 in card 100 then 
launches an authentication/key exchange & I/O process 
related program stored in ROM 102 in (a) of FIG. 5. 

With this program, mutual authentication and key 
exchange are executed between encryption processing 
unit 3010 and audio card 10 0. 

That is, in the authentication/key exchange 
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process, cipher key (encryption key) generation/ saving 
unit 3140 generates a challenge key, which is encrypted 
by encryption processor 3110, and the encrypted key is 
sent to audio card 100 via mutual authentication/key 
5 exchange & encrypted information I/F controller 3120. 

Then, audio card 100 decrypts the encrypted challenge 
key to execute authentication. 

Furthermore, a response key saved in card unique 
O ID information & key information recording region (RAM) 

Cn 10 103 is encrypted and is sent to encryption processing 

to unit 3010, which decrypts the encrypted response key to 

m execute authentication. 

~~ In these authentication processes, each other's 

IDs are checked. 
15 For example, CPU/MPU 101 in card 100 in (a) of 

FIG. 5 reads the unique ID (this ID is written in, 
e.g., a ROM (not shown) in information recorder /player 
3000) of the apparatus in FIG. 23 via information 
recorder/player 3000, and can check if that apparatus 
20 is an authentic one which matches itself (card 100). 

Likewise, system controller 3020 in FIG. 23 reads 
the unique ID of card 100 in (a) of FIG. 5 via 
information recorder/player 3000, and can check if that 
apparatus is an authentic one which matches itself 
2 5 (apparatus in FIG. 23). 

In this manner, mutual authentication is done 
between card 100 and the apparatus shown in FIG. 23 
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(step ST10) • 

If mutual authentication has failed, the 
subsequent processes are canceled (not shown in 
FIG. 24 ), and information recording/playback on/from 
5 card 100 is inhibited. 

If mutual authentication has succeeded, a common 
cipher key (encryption key) is generated based on a 
random number or the like between audio card 100 and 
encryption processing unit 3010, and the common cipher 
10 key (encryption key) information is temporarily saved 

in both card unique ID information & key information 
recording region (RAM) 103 and cipher key (encryption 
key) generation/ saving unit 3140 (step ST12). 

In this way, both card 100 and the apparatus in 
15 FIG. 23 have common key information required for 

decryption. 

Upon completion of a series of mutual 
authentication/key exchange processes, encryption 
processor 3110 encrypts digital information (audio 
2 0 information or image information) sent from input data 

transfer destination switching unit 3210 using the 
common cipher key (encryption key) generated by the 
aforementioned processes (step ST14). 

In this encryption, encryption conversion (for 
25 randomly shuffling data in encryption units) is done 

every encryption unit (64 bits) for compressed audio 
information recording region 2740 shown in (d) and (e) 



of FIG* 22 , thus rewriting data. 

In this case, ADTS header 2 710 and fraction region 
"g" do not undergo encryption conversion, and are 
transferred to information recorder/player 3000 in a 
non-encrypted , plane state. 

The encrypted digital information is transferred 
to card 100, and is recorded at a predetermined 
location of data region 113 of card 100 (upon recording 
in step ST16 ) . 

When information to be copyright-protected is 
recorded on card 100, information of CGMS-D is 
transferred and recorded at the same time. 

On the other hand, upon playback of encrypted 
information, data (audio information or image 
information) that has undergone encryption conversion 
in encryption units, and non-encrypted ADTS header 2710 
and region "g" are transferred from card 100 to 
encryption processing unit 3010 via information 
recorder/player 3000 (upon playback in step ST16). 

The transferred encryption-converted data is 
decrypted by decryption processor 3130 (step ST18), and 
decrypted data is output to output data/control 
information transfer destination switching unit 
(data/command bus line) 3220. 

Note that the encryption-converted data includes 
CGMS-D information if it is copyright-protected. 

An example of the process upon playback will be 
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explained in more detail below. 

When information recorded on audio card 100 with 
the copy protection function is to be played back, 
information recorder/player 3000 reads information in 
program chain set information recording region 140 
shown in (e) of FIG. 5, stores at least a portion of 
the read information in the internal memory (RAM) of 
system controller 3020, and searches for an audio 
information file to be played back using the 
information temporarily saved in the memory. 

Before playback of an audio information file, 
system controller 3020 reads CGMS-D information which 
pertains to that information, and determines whether 
the information is transferred to output data/control 
information transfer destination switching unit 3220 
directly or via encryption processing unit 3010, thus 
selecting one of these transfer routes. 

When encrypted information is transferred from 
information recorder/player 3000, the mutual 
authentication/key exchange processes in steps ST10 to 
ST12 in FIG. 2 4 are executed, and a common cipher key 
(encryption key) is held between encryption processing 
unit 3010 and audio card 100. 

The encrypted information input to decryption 
(decipher) processor 3130 via mutual authentication/key 
exchange & encrypted information I/F controller 3120 
has a structure shown in (e) of FIG. 22. 
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The encrypted information is decrypted 
(deciphered) every encryption unit, and encryption 
units of decrypted, plane information are re-arranged 
to an original data sequence. 
5 Digital information (plane digital information 

after decryption) transferred from output data/control 
information transfer destination switching unit 
(data/command bus line) 3220 is processed as follows: 
Q (31) the digital information is decoded by audio 

01 10 decoder 3220 to obtain a linear PCM signal, which is 

yn temporarily saved in audio buffer 3410, when it is 

m audio information; 

(32) the digital information undergoes "code — » 
character conversion" by character generator 3340, and 

15 is then temporarily saved in text line buffer 342 0 as 

image information when it is text information; 

(33) the digital information is converted into 
bitmap information in image decoder 3330, and is 
temporarily saved in page buffer 3430 when it is still 

20 image information compressed by JPEG or MPEG 

( I-picture ) ; and 

(34) video processor 3370 composites the still 
image information in the bitmap format, temporarily 
saved in page buffer 3430 and the text information 

2 5 image temporarily saved in line buffer 3420 to generate 

a single composite image, as needed. 

The composite image obtained in this way is 



o 



♦ 
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displayed on image display 3710 such as a color liquid 

crystal display panel or the like. 

On the other hand, the audio information 

temporarily saved in audio buffer 3410 is transferred 
5 to D/A converter (DAC) 3360 in units of frames, and is 

converted into an analog signal, which is output to 

external output terminal 3720 connected to a 

loudspeaker or the like. 
Q Note that the display timing of text or still 

jFi 10 image information on image display 3710 upon playing 

= S3 

back audio information is controlled in synchronism 

x s : 

with the audio frame number to be played back. 

ill 

System controller 3020 shown in FIG. 23 sets a 
;pj value obtained by dividing the "total number of frames" 

f7 15 of music #p shown in, e.g., (b) of FIG. 8 by the 

"number of still images to be displayed during 
playback" of music #3 as the "number of audio frames to 
be played back per still image". 

System controller 302 0 always monitors the audio 
20 frame numbers in playback (the accumulated number of 

audio frames), and switches still image information in 
page buffer 3430, which is to be sent to image display 
(color liquid crystal display) 3710, when the played- 
back audio frame number has reached a predetermined 
25 value. 

Note that system controller 3020 in FIG. 23 mainly 
executes both the "music number combining (tune 
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combining)" and "music number dividing (tune dividing)" 
processes described earlier with reference to FIG. 2, 
and sends changed management information (CI# or AOBI#) 
to information recorder /player 3000 via output 
5 data/control information transfer destination switching 

unit (data/command bus line) 3220. 

As a result , information in management information 
recording region 130 in (d) of FIG. 5 is rewritten. In 
q the "music number dividing (tune dividing)" process, 

m 10 information (audio data corresponding to AOBI #3, 

AOBI#5, and AOBI#6 in the example shown in (c) and (d) 

of FIG. 2) in audio object recording region 131 is also 

LxJ .... 
" changed (the process for dividing audio information 

^ file AOBI#3 into AOBI#5 and AOBI#6). 

ft 15 FIG. 25 is a flow chart for explaining the method 

y of making only an image pointer (IPI) of the first AOBI 

(TKI) in a music number /tune (track) valid as a pointer 
of a still image to be displayed when the music 
number /tune (track) is made up of a plurality of pieces 
20 of AOBI (TKI) . 

The number of pieces of AOBI (TKI in FIG. 21) 
(three pieces of AOBI in music #|3 in FIG. 8; three 
pieces of TKI in music B in FIG. 21) is detected from 
PGCSI/AOBSI or the like shown in FIG. 5 or FIG. 8 
25 (step ST1000 ) . 

If the detected number of pieces of AOBI (TKI) is 
1 (YES in step ST1002), image pointer information IPI 



(TKI_IOB_SRP) of one AOBI (AKI) which forms that music 
number/tune (track) is used (step ST1004). 

On the other hand, if a plurality of pieces of 
AOBI (AKI) are detected (NO in step ST1002), only image 
pointer information IPI ( TKI_IOB_SRP ) of the first AOBI 
(TKI) in the music number/tune (track) of two or more 
pieces of AOBI (TKI) which form that music number /tune 
(track) is used (step ST1006). 

Then, the recorded/unrecorded flag (2 bits) in (e) 
of FIG. 16 or (d) of FIG. 19 is read (step ST1008). 

For example, if this 2-bit flag is 00b, it 
indicates the absence of corresponding still image data 
(IMG_xx.IOB) (i.e., no still image data is recorded). 
If this 2-bit flag is 01b, it indicates the presence of 
corresponding still image data (lMG_xx.IOB) (i.e., 
still image data is already recorded). 

If this 2-bit flag is 10b, it indicates the 
presence (recorded) of, e.g., still image data with 
text; if this 2-bit flag is lib, it indicates, for 
example, the presence (recorded) of data (text data 
alone, motion JPEG file, etc.) other than a still 
image . 

Such recorded/unrecorded flag is managed together 
in independent directory 2400 on the file system shown 
in FIG. 7. 

If the recorded/unrecorded flag indicates the 
presence of corresponding still image data (IMG_xx.IOB) 
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(YES in step ST1010), the recorded, corresponding still 
image data (IMG_01.IOB designated by IPI#1 in, e.g., 
music #a in FIG. 8) is accessed using image pointer 
information IPI ( TKI_IOB_SRP ) of the AOBI (TKI), use of 
5 which is determined in step ST1004 or ST1006 upon 

playing back the music number /tune (track) of interest 
(step ST1012) . 

If the recorded/unrecorded flag indicates the 
p presence of corresponding text data (TXT_xx.TOB) (YES 

m 10 in step ST1014), the recorded, corresponding text data 

! ft 

JI (TXT_02.TOB and TXT_03.TOB designated by TPI#2 in, 

e.g., music #p in FIG. 13) is accessed using text 
7 1 pointer information TPI (see FIGS. 13 and 14) of the 

^ AOBI (TKI), use of which is determined in step ST1004 

^ 15 or ST1006 upon playing back the music number/tune 

fa, 

O (track) of interest (step ST1012). 

O 

The accessed still image data and/or text data 
are/is played back upon playback of the music 
number/tune of interest, and are/is displayed on, e.g., 

20 image display 3710 in FIG. 23 (step ST1018). 

FIG. 2 6 is a flow chart for explaining the method 
of matching the display order mode/still image display 
timing mode of divided music numbers (divided tunes) 
with those before the dividing process, matching text 

25 information associated with the divided music numbers 

(divided tunes) with that before the dividing process, 
and copying all kinds of still image information and 
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text information in newly created AOBI (TKI) from the 
same kinds of information of AOBI (TKI) older than the 
new AOBI (TKI) • 

Music /tune (track) #a having AOBI (TKI) #1 in FIG. 
5 4 is divided to generate new music number/new tune 

(track) #a having AOBI (TKI) #1, and new music 
number /new tune (track) having AOBI (TKI) #8 (step 
ST2000) . 

It is then checked if image pointer information 

10 IPI#1 included in music #a before the dividing process 

includes a description of display mode information (51, 
52) shown in FIGS. 10, 20, etc. (step ST2002). 

If image pointer information IPI#1 includes the 
description of display mode information (51, 52) (YES 

15 in step ST2002), the display mode information (51, 52) 

of image pointer information IPI#1 included in music #ot 
before the dividing process is transplanted (copied) to 
new music #a and new music generated by the dividing 
process (step ST2004). 

20 The display mode information (51, 52) transplanted 

(copied) to new music #a and new music is stored in 
the internal RAM of system controller 3020 in FIG. 23, 
and/or is recorded in RAM 104 in (a) of FIG. 5 (or data 
region 1820 in (b) of FIG. 6). 

25 It is checked if music #a before the dividing 

process includes a description of text pointer 
information TPI (step ST2006). 



If music #<x includes the description of text 
pointer information TPI (YES in step ST2006), the 
contents of text pointer information TPI#1 included in 
music #a before the dividing process are transplanted 
(copied) to new music #a and music generated by the 
dividing process (step ST2008). 

The text pointer information transplanted (copied) 
to new music #ot and new music #C is stored in the 
internal RAM of system controller 3020 in FIG- 23 , 
and/or is recorded in RAM 104 in (a) of FIG. 5 (or data 
region 1820 in (b) of FIG. 6). 

The transplanted (copied) display mode information 
(51, 52) and/or text pointer information are/is set in 
each AOBI (TKI) of new music #ot and new music #C (step 
ST2010) . 

In this case, the transplanted (copied) display 
mode information (51, 52) and/or text pointer 
information may be set not only in AOBI having valid 
image pointer information IPI but also in each AOBI 
having invalid IPI . 

Still images and/or text (that can include jacket 
images, word cards, and the like) are played back and 
displayed while being switched as needed on the basis 
of all pieces of transplanted (copied) information 
(including display mode information and/or text 
information) (step ST2012). 

FIG. 27 is a flow chart for explaining the method 
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of matching the display order mode/still image display 
timing mode of the combined music number (combined 
tune) with those to be played back first by merging 
still image information in a succeeding music number 
5 (succeeding tune) with that in a preceding music number 

(preceding tune) when two music numbers/two tunes 
(tracks) are combined to generate a new music 
number /new tune (track). 

Music /tune (track) #a having AOBI (TKI) #1 and 

10 music /tune (track) #P having AOBI (TKI) #2 are combined 

to generate music #y (step ST3000). 

In this case, in the example shown in FIG, 1, 
pieces of still image information IMG_03.IOB and 
IMG_04.IOB of music #0 are merged with pieces of still 

15 image information IMG_01.IOB and IMG_02.IOB of 

preceding music #a, so that music #y has pieces of 
image information IMG_01.IOB to IMG_04.IOB. 

Of combined music number /combined tune (track) #y, 
display mode information (51, 52 in FIG. 20) in image 

20 pointer information IPI of AOBI#l of music #a to be 

played back first is used as that of combined music #y 
(step ST3002) . 

If the display mode information used includes a 
description of display order setting mode information 

25 (51 in FIG. 20) (YES in step ST3004), the display 

method of still images (IMG_xx.IOB) of music #y is 
determined in accordance with the contents of the 
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display order setting mode information (step ST3006). 

Examples of the display method determined in this 
step include sequential display, random display, 
sequential display after shuffling, display while 
browsing images, and the like. 

If the display mode information used includes a 
description of display timing setting mode information 
(52 in FIG- 20) (YES in step ST3008), the display 
timings of still images (IMG_xx.IOB) of music #y are 
determined in accordance with the contents of the 
display timing setting mode information (step ST3010). 

Examples of the display timing determined in this 
step include the still image display switching timings 
synchronized with divisions of audio frames (see (c) of 
FIG. 22 of music #y to be played back, the still image 
display switching timings set at given time intervals 
using a timer, and the like. 

Upon playback of music #y, still images (that can 
include text information such as words and the like as 
needed) are played back and displayed while being 
switched based on the determined display method 
(display order) and/or at the determined display 
timings (step ST3012). 

FIG. 28 is a flow chart for explaining the method 
of displaying jacket images using still image 
information of a music number /tune (track) included in 
a selected play list or a selected music 
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number/ selected tune (track) when a play list or music 
number /tune (track) is selected. 

It is checked if a play list (default play list or 
user-defined play list) is selected (step ST4000). 
5 This checking is done by system controller 3020 in 

FIG. 23 in response to depression of a play list select 
button on a remote controller (not shown) by the user. 

If the play list is selected (YES in step ST4000), 
O the first music number/first tune (music #a in the 

CP 10 default play list or music #0 in the user-defined play 

03 list in FIG. 10) is specified (step ST4002). 

Li I 

£0 On the other hand, if the play list is not 

» selected (NO in step ST4000) but if a specific music 

Q 

,q number/specific tune (track) is directly selected (YES 

jj, 15 in step ST4004), the selected music number/ selected 

2 tune (the music number /tune of user's choice) , e.g., 

music #P in FIG. 10, is specified (step ST4006). 

Such direct selection of a music number/tune 
(direct music number designation or direct tune 
20 designation) is done by system controller 3020 in 

FIG. 23 in response to depression of a music 
number /tune (track) select button on the remote 
controller (not shown) by the user. 

Some or all pieces of image information 
25 (IMG_02.IOB to IMG_04.IOB for music #(3 in the example 

shown in FIG. 10) designated by image pointer 
information IPI of the specified music number/specified 
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tune are allowed to be used in display of jacket images 
and/or word cards (text images based on text pointer 
information TPI) on the basis of the contents of 
recorded/unrecorded flags (see FIG. 16, FIG. 17 , or 
5 FIG. 19) and the contents of designation 

presence/absence flags (see FIG. 18) of jacket images 
and the like (step ST4008). 

Some or all pieces of image information 

0 (IMG_02.IOB to IMG_04.IOB for music #p in the example 

01 10 shown in FIG. 10) which are allowed to be used are 

s 5=5 

yg displayed in accordance with the display method (e.g., 

£3 sequential) designated by display order setting mode 

1 = i 

s" information 51 included in display mode information 

2 (see FIG. 10 or FIG. 20) and the display timings (e.g., 
fT 15 in units of a predetermined number of audio frames) 

S designated by display timing setting mode information 

52 included in the display mode information, upon 
playback of the selected music number/selected tune 
(music #3 in the example in FIG. 10) (step ST4010). 

20 The advantages or effects obtained according to 

the embodiment of the present invention described above 
may be summarized as follows. 

1 . According to the embodiment of the present 
invention, audio information with still images (audio 

25 information that can simultaneously play back still 

images) can easily undergo an edit process such as a 
music number combining process (tune combining 
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process ) f dividing process, or the like within a short 
period of time without largely changing management 
information . 

2. In the edit process such as a music number 
combining process (tune combining process) , music 
number dividing process (tune dividing process), or the 
like, still images to be displayed upon playback of 
audio information can be easily set in units of music 
numbers (in units of tunes). 

3. Even after music numbers (tunes) are combined, 
the playback range of a music number (tune) before the 
combining process is left or remained as a "management 
unit ( cell/AOB/ track ) " indicating the playback range in 
audio information (AOB), and management information 
(CI/AOBI/TKI ) that pertains to the management unit is 
recorded on the information storage medium as 
management information. Hence, the contents of 
management information need only be changed slightly 
before and after the music number combining process 
(tune combining process), and control upon editing can 
be facilitated. 

4. When one music number (tune) is made up of a 
plurality of "management units ( cells /AOBs/tracks ) " (as 
a result of, e.g., the music number combining 
process/tune combining process), since designation 
information that pertains to still image information 
described within management information (CI/AOBI/TKI) 
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which pertains to the management unit to be played back 
first in that music number (tune) indicates still image 
information to be displayed upon playing back the music 
number (tune) of interest, the memory size of the 
playback apparatus can be reduced. 

In this case, when management information that 
pertains to a management unit to be played back in the 
latter half of the music number (tune) records 
designation information of still image information to 
be played back in units of music numbers (in units of 
tunes), the management information that pertains to all 
management units which form the music number (tune) of 
interest need only be temporarily saved in the memory 
of the playback apparatus before playback of the music 
number . 

5. Since information which designates still image 
information (IOB) rejected from the display target 
range after the music number combining process (tune 
combining process) is recorded in management 
information which pertains to management units 
(cells/AOBs/tracks ) to be played back as the second and 
subsequent units in that music number (tune), the user 
can re-select still image information (IOB) to be 
displayed in units of music numbers (in units of 
tunes), using an apparatus with advanced function, for 
example . 

6. Since designation information to still image 
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information (IOB) before the dividing process is 
directly copied and saved after the music number 
dividing process (tune dividing process), the user can 
be given a sense of security that "still image 
5 information to be displayed is saved even after the 

dividing process". 

7. Still images (that can include jacket images 
and word card images ) to be played back in a given 
q music number (given tune) can be displayed while being 

01 10 switched along with the progress of the music number 

yg (tune) in a predetermined order and/or at predetermined 

fa timings in accordance with display mode information 

" included in IPI in the first AOBI/TKI of that music 

E 

^ number ( tune ) . 

15 As described above, the information storage medium 

2 (audio card or the like) according to the present 
invention can have information (attribute information 
such as display order mode/display timing mode, and the 
like, flags indicating the presence/absence of still 

20 image information, and the like) that pertains to 

handling of various kinds of information (still image 
information such as jacket images and the like, and 
text information such as words and the like) associated 
with audio information (music number or tune). 

25 According to the information playback method of 

the present invention, corresponding jacket images, 
word text, and the like can be displayed while being 
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automatically switched upon playback of a music number 
(tune), using the information (attribute information 
such as display order mode/display timing mode f and the 
like, flags indicating the presence/absence of still 
image information , and the like) that pertains to 
handling , which information is recorded on the 
information storage medium (audio card or the like). 

Additional advantages and modifications will 
readily occur to those skilled in the art. Therefore , 
the invention in its broader aspects is not limited to 
the specific details and representative embodiments 
shown and described herein. Accordingly, various 
modifications may be made without departing from the 
spirit or scope of the general inventive concept as 
defined by the appended claims and their equivalents. 



